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(54) Color picture processing method and apparatus 

(57) The invention provides a color picture process- 
ing method and a color picture processing apparatus by 
which the amount of picture data can be reduced without 
degrading the picture quality in accordance with the sen- 
sations of human beings and further reduction in amount 
of data can be realized by data compression without 
degrading the picture quality and besides extraction of a 
body, a color change and reduction in number of colors 
can be performed simply. The color picture processing 
apparatus comprises a color picture data inputting sec- 
tion (1 ), a category discrimination section (2) for discrim- 
inating, from color picture data, color information based 
on categorical perception of human beings, a picture 
data conversion section (3) for converting the color pic- 
ture data, a region extraction section (4) for specifying 
and extracting a partial region of a picture, a color chang- 
ing section (5) for changing some or all of colors of the 
picture, a data compression section (6) for compressing 
the color picture data after the conversion, and a picture 
displayable data conversion section (7) for converting the 
color picture data after the conversion into picture dis- 
playable data to be inputted to a picture displaying sec- 
tion (8) using a table (9) which indicates a corresponding 
relationship between the color information and the pic- 
ture displayable data. 
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Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

This invention relates to a color picture processing method and a color picture processing apparatus for use to 
perform picture processing such as displaying processing for a color monitor apparatus for retrieval of a color picture by 
an operator or processing of varying the color of an arbitrary body in a picture in such a manner as to vary, for example, 
the color, the gloss, the metallic feeling or the quality feeling of a picture of an arbitrary body in a color picture to modify 
the manner in which the color or the surface of the body looks or the atmosphere of the entire picture while maintaining 
the naturalness in shadow or color of the picture. 

2. Description of the Related Art 

Generally, a design system which makes use of a computer and a color monitor or a desk-top publishing system 
which produces computer graphics or produces an illustrated document which includes both of a text and a picture 
requires operation of a color picture by an operator. 

For example, in designing of a commodity (a package or a car) or a poster or in production of an illustrated document 
using a computer, an operator performs various operations such as an operation of producing a picture on a monitor, 
an operation of inputting an original picture using a reading apparatus or a like apparatus, an operation of allocating 
various colors to different portions of the picture, an operation of adjusting or modifying the thus allocated colors and 
an operation of modifying the material feeling of the surface of a body. 

Meanwhile, in production of an electronic catalogue, for example, the color of a body in a single original picture is 
changed to produce a plurality of pictures as in an electronic catalogue of an automobile. This can reduce the time 
otherwise required for photographing of a large number of bodies. 

In such color picture processing on a computer, it is desired that the picture be higher in degree of accuracy and 
can be operated simply and freely; data have a form simple to operate; a resulted picture after modification in color or 
shape can look natural; and the interface (human interface) between the computer and an operator allow easier use. 

By the way, an RGB method is used most normally to perform such processing of a color picture as described above. 
This is because the RGB data form is employed as an output signal form from an image scanner or an input signal form 
to a display unit by a large number of appliances. 

Meanwhile, processing (conversion) of picture data involves processing of specifying a desired region in a picture, 
processing of changing the color of an arbitrary body in the picture, JPEG (Joint Photographic Experts Group, an inter- 
national standard of a color picture data compression method) compression for reducing the amount of data and so forth. 

The body extraction processing particularly includes processing of designating a profile one by one picture element 
by manual operation by an operator using a mouse while keeping RGB signals in the RGB signal form, processing of 
converting RGB signals into data of the hue, the saturation and the brightness to extract a particular color, and so forth. 

Meanwhile, the color changing processing includes processing of representing picture data in a body reflection 
model which employs RGB signals to change a color, processing of representing picture data in the hue, the brightness 
and the saturation and changing the hue, the brightness or the saturation, and so forth. 

Further, for the data compression, a signal form such as the YCrCb or the Lab in which data are represented in the 
brightness and a color in order to assure a high compression efficiency is employed frequently. 

Further, as a method of changing a color of a body in a picture while maintaining the naturalness of the picture* a 
method of changing a color of a body in a picture only with a hue value of picture data of the body or a method whjjch 
makes use of a simple body reflection model is available. Meanwhile, a change of the color feeling or the material quality 
feeling is realized by inputting a body having a different gloss or a different material quality separately in advance and 
patching a picture of the body to an object picture (partially replacing picture data). 

Also a method has been proposed wherein picture data are represented based on a strict reflection model and 
various parameters of a color of a body and so forth are automatically derived from the model and changed to change 
the color of the body. More particularly, picture data are represented as a reflection model using parameters of a color 
of a body, illumination light and so forth, and the parameters are changed to change the color of the body 

However, the RGB form as a data representation form which is employed in such color picture processing methods 
as described above requires extraction of a body by manual operation, and much time is required for the extraction 
processing. Further, although such a method which makes use of a reflection model of light of a body as described 
above is available as a color changing method, also the color changing processing by this method requires detection of 
parameters of a reflection model such as a body color for each one picture element, and a large amount of calculation 
is involved in and much time is required for the detection processing. 
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Further, when a picture of RGB signals is displayed on a display unit, it cannot be displayed in full colors in which 
8 bits are used for each color from a limitation of a memory for display data (frame memory), but can be displayed only 
in 256 colors in which 8 bits are used for each color. Consequently, processing of reducing data of approximately 
16,000,000 colors wherein each color is constituted from 24 bits to data of 256 colors of 8 bits is required. 

5 As a method for such color reduction processing as described just above, a method wherein an RGB color space 

is divided into several regions in each of which data have a same color or another method wherein appearance frequen- 
cies of data in an entire picture are detected and 256 colors are allocated in order to colors having comparatively high 
appearance frequencies is available. However, those methods have a subject to be solved in that a large amount of 
calculation is required and much time is required for the calculation processing (several seconds are required even with 

w a work station) or the manner of dividing a color space must be changed for each picture in order to assure a desirable 
picture quality. 

Meanwhile, the method wherein picture data are converted into data of the hue, the saturation and the brightness 
to extract a body or change a color has a subject to be solved in that a desired body or region cannot be extracted or a 
natural result of a change in color of a shadow or gloss cannot be obtained. 

75 By the way, the data form of the YCrCb or the Lab used in data compression processing is obtained by mathematical 

conversion of the RGB form. In such forms, picture data are represented in a color component and a brightness com- 
ponent and allow efficient reduction in amount of data by JPEG compression mentioned above without causing much 
degradation in picture quality. 

However, the data amount of any of the data forms mentioned just above is not different from that of the RGB form. 

20 In particular, in any of the data forms, since the amount of data can be reduced without compression, for example, where 
original RGB data are constituted from 8 bits for each color, the data are sometimes represented with totaling 1 6 bits 
including 8 bits for a brightness component and 4 bits x 2 for a color component. Such representation makes use of the 
fact that the visual sense of human beings has a characteristic that it is less sensitive to a variation in color than to a 
variation in brightness. 

25 However, where compression processing in which such data form as the YCrCb or the Lab is employed is performed, 

since the bit numbers of color components are reduced uniformly, significant degradation in quality of a picture sometimes 
occurs depending upon the color. 

Meanwhile, with the method of changing in color by a change in hue value according to the prior art described 
above, a color can be changed while maintaining the naturalness of a shadow or gloss of the surface of a body to some 

30 degree. However, if the saturation or the brightness is changed in order to perform delicate adjustment of a color, then 
the shadow or gloss looks unnatural, that is, the shadow becomes whitish or the gloss disappears. 

On the other hand, with the change of a color which makes use of a simple reflection model, the naturalness can 
be maintained to some degree. However, only a color can be changed, but the manner in which gloss or a color looks 
(for example, an effect to provide the manner, in which a color looks, with the directivity so that it may look brilliantly) 

35 cannot be changed. 

Further, with the method wherein another body is inputted separately in advance in order to change the feeling of 
gloss or the manner in which a color looks, the inputting operation is cumbersome. Further, it is only possible to change 
a property of the thus inputted body, and a free change is not permitted. 

As a possible solution to the subjects described above, the following method which is based on a strict model and 
40 a change in parameter of the model has been proposed. 



45 



50 



55 



BNSDOCID: <EP 0709808 A2_l_> 



3 



EP 0 709 808 A2 

In particular, a color change is performed making use of the expression (1) of a reflection model given below: 
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As seen from the expression (1) above, a color (picture data of a body) a human being sees is represented as a 
sum of a body color vector and an applicable constant (diffused reflection component), an illumination light vector and 
an applicable constant (mirror reflection component), and secondary reflection light (environmental light) which depends 
upon surrounding bodies and an applicable constant (environmental light component). 

Here, in the expression (1) above, the body color, the color of illumination light and the color of secondary reflection 
light are estimated from an original picture, and the constants K1 , K2 and K3 are determined based on the thus estimated 
colors and picture data of the original picture. The color of the body and the color of the illumination light are derived by 
applying, to a distribution of picture data on an rg chromaticity plane, a straight line interconnecting the body color and 
the color of the illumination light. Further, a vector in a direction perpendicular to a plane defined by vectors indicating 
the body color and the illumination light in a color space is detected as secondary reflection light. 

Since three RGB representations are obtained for the three unknown quantities in such a manner as described 
above, the simultaneous equations with three unknowns are solved to find out K1 , K2 and K3. 

After the three unknown quantities K1 , K2 and K3 are found out, a color change may be performed by changing a 
body color (Rd, Gd, Bd) to an aimed color for a color change (Rd\ Gd\ Bd') to obtain new picture data (Ro\ Go', Bo') in 
accordance with an expression (2) given below. Also when it is intended to change the illumination light or the secondary 
reflection light, new picture data are obtained in a similar manner. 
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With the method described above, the color of a body or the color of an illumination light source which is a 
parameter of the model can be derived automatically by means of a computer without the necessity of a manual desig- 
nation operation by an operator. 
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* 

However, picture data inputted from a camera or an image scanner often includes data which do not conform to the 
model due to noise or soiling to an original. If a color change is performed using those data uniformly in conformity with 
the model, then the noise (error from the model) is sometimes expanded so that it looks striking. 

For example, particularly if a dark color is changed to a light color, that is, if data of a dark color which has a com- 
5 paratively low S/N ratio and includes comparatively high noise is changed to data of a light color, then the expansion 
ratio of noise is increased and degradation in picture quality becomes striking. Consequently, the method described 
above has a subject to be solved in that a variation in color which is not striking with an original picture becomes striking 
with a picture after a color change making the picture cause an observer to feel rough. 

Further, according to the color change based on a reflection model of the expression (1) above, a natural result of 
w a color change may not possibility be obtained when an influence of unexpected reflection of a surrounding object is 
had on data of an object of a color change. 

In particular, the color change based on a reflection model is performed by such movement of data in a color space 
as illustrated in FIG. 33. FIG. 33 illustrates movement of a data distribution when the color of body data which are 
distributed in a region of purple is to be changed to green. A manner of movement of the distribution can be recognized 
is from manners of the data distribution before and after the movement by comparing symbols (A, B, C, D) applied in the 
proximity of each of the representations of the data distribution. 

Here, it is assumed that data include an influence of unexpected reflection of the blue of an original body. While it 
is considered that the reflection occurs in the proximity of the symbol "A" of the original data distribution, the movement 
of the data by the color change moves the reflected portion "A" of the blue to a position near a region of yellow on the 
20 opposite side to the blue. Conversely, the portion "B" moves to a position near a region of blue. 

Consequently, the color change based on a reflection model has a subject to be solved in that it makes the color of 
a reflected portion unnatural. 

SUMMARY OF THE INVENTION 

25 

It is an object of the present invention to provide a color picture processing method and a color picture processing 
apparatus by which the amount of picture data can be reduced without degrading the picture quality in accordance with 
the sensations of human beings and further reduction in amount of data can be realized by data compression such as 
the JPEG without degrading the picture quality. 
30 It is another object of the present invention to provide a color picture processing method and a color picture process- 
ing apparatus by which extraction of a body, a color change and reduction in number of colors can be performed simply. 

It is a further object of the present invention to provide a color picture processing method and a color picture process- 
ing apparatus by which noise of data of a body picture of an object of a color change is reduced or noise expanded by 
a color change is reduced to obtain a picture of an improved picture quality. 
35 It is a still further object of the present invention to provide a color picture processing method and a color picture 
processing apparatus by which a natural result conforming to the sensations of human beings can be obtained even by 
a change of a color of a body which is influenced by unexpected reflection or a like effect. 

In order to attain the objects described above, according to an aspect of the present invention, there is provided a 
color picture processing method, which comprises the steps of discriminating to color information of which one of a 
40 plurality of categories of color information based on a plurality of classified colors inputted color picture data belong, 
converting the color picture data so as to have the thus discriminated color information, and performing succeeding 
picture processing using the color picture data after the conversion. 

With the color picture processing method, since a color of color picture data is discriminated based on the categorical 
perception of human beings, the amount of picture data can be reduced without degrading the picture quality in accord- 
45 ance with the sensations of human beings. Further, extraction of a body, a change of a color, reduction of the number 
of colors and so forth can be performed simply. The color picture processing method is advantageous also in that the 
amount of data can be further reduced without degrading the picture quality by making use of a data compression 
technique such as the JPEG. 

According to another aspect of the present invention, there is provided a color picture processing method, which 
so comprises the steps of representing a color of picture data as a color code representing one of a plurality of classified 
colors and a deviation between the color of the picture data and a representative color of a color category to which a 
color represented by data including the color code information belongs, and performing succeeding picture processing 
using the thus represented color. 

With the color picture processing method, since a color of color picture data is discriminated based on the categorical 
55 perception of human beings, the amount of picture data can be reduced without degrading the picture quality in accord- 
ance with the sensations of human beings. Further, extraction of a body, a change of a color, reduction of the number 
of colors and so forth can be performed simply. The color picture processing method is advantageous also in that the 
amount of data can be further reduced without degrading the picture quality by making use of a data compression 
technique such as the JPEG. 
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According to a further aspect of the present invention, there is provided a color picture processing apparatus, com- 
prising color picture data inputting means for inputting color picture data, category discrimination means for discriminating 
to color information of which one of a plurality of categories of color information classified based on categorical perception 
of human beings the color picture data inputted from the color picture data inputting means belong, picture data con- 

5 version means for converting the color picture data so as to have the color information discriminated by the category 
discrimination means, and picture processing means for performing picture processing using the color picture data 
converted into the color information based on the categorical perception by the picture data conversion means. 

With the color picture processing apparatus, since a color of color picture data is discriminated based on the cate- 
gorical perception of human beings, the amount of picture data can be reduced without degrading the picture quality in 

10 accordance with the sensations of human beings. Further, extraction of a body, a change of a color, reduction of the 
number of colors and so forth can be performed simply. The color picture processing method is advantageous also in 
that the amount of data can be further reduced without degrading the picture quality by making use of a data compression 
technique such as the JPEG. 

According to a still further aspect of the present invention, there is provided a color picture processing method, 

15 which comprises the steps of discriminating to color information of which one of a plurality of categories of color infor- 
mation classified based on categorical perception of human beings inputted color picture data belong, converting the 
color picture data so as to have the thus discriminated color information, and performing region extraction processing 
of specifying and extracting, from the color picture information after conversion into the color picture information based 
on the categorical perception, a partial region of a picture constructed from the color picture data after the conversion. 

20 Accordingly, with the color picture processing method, since region extraction processing of a body can be performed 
only by determination regarding a code of a color of picture data (whether or not the color is the same as a designated 
color), processing conforming to the sensations of human beings can be performed at a higher speed than that by 
another method which is based on manual operation or makes use of the hue. 

According to a yet further aspect of the present invention, there is provided a color picture processing apparatus, 

25 comprising color picture data inputting means for inputting color picture data, category discrimination means for discrim- 
inating to color information of which one of a plurality of categories of color information classified based on categorical 
perception of human beings the color picture data inputted from the color picture data inputting means belong, picture 
data conversion means for converting the color picture data so as to have the color information discriminated by the 
category discrimination means, and region extraction means for specifying and extracting, from the color picture data 

30 after conversion into the color information based on the categorical perception, a partial region of a picture constructed 
from the color picture data after the conversion, the region extraction means including color designation means for 
instructing a color to be specified in the picture, comparison means for comparing the color designated by the color 
designation means and colors of picture elements of the color picture data with each other, and means for determining, 
when a result of the comparison by the comparison means proves that the designated color and the colors of the picture 

35 elements of the color picture data are the same color, the picture elements to be picture elements which constitute the 
region to be specified. 

Accordingly, with the color picture processing apparatus, since region extraction processing of a body can be per- 
formed only by determination regarding a code of a color of picture data (whether or not the color is the same as a 
designated color), processing conforming to the sensations of human beings can be performed at a higher speed than 
40 that by another method which is based on manual operation or makes use of the hue. 

According to a yet further aspect of the present invention, there is provided a color picture processing method, which 
comprises the steps of discriminating to color information of which one of a plurality of categories of color information 
classified based on categorical perception of human beings inputted color picture data belong, converting the color 
picture data so as to have the thus discriminated color information, and performing color changing processing of chang- 
es ing, based on the color picture data after conversion into the color information based on the categorical perception, some 
or all of colors of a picture constructed from the color picture data after the conversion. 

Accordingly, with the color picture processing method, since color changing processing can be realized only based 
on determination regarding a code of a color of picture data (whether or not the color is the same as the designated 
color) without the necessity of extraction of the color of a body, the color picture processing method is advantageous in 
so that calculation processing for changing a vector in a color space is unnecessary and the processing time for changing 
a color is reduced as much, and high speed processing conforming to the sensations of human beings can be performed. 

According to a yet further aspect of the present invention, there is provided a color picture processing apparatus, 
comprising color picture data inputting means for inputting color picture data, category discrimination means for discrim- 
inating to color information of which one of a plurality of categories of color information classified based on categorical 
55 perception of human beings the color picture data inputted from the color picture data inputting means belong, picture 
data conversion means for converting the color picture data so as to have the color information discriminated by the 
category discrimination means, and color changing means for changing, based on the color picture data after the con- 
version into the color information based on the categorical perception by the picture data conversion means, some or 
all of colors of a picture constructed from the color picture data after the conversion, the color changing means including 
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means for changing a color parameter which has information of at least one of a code of a color classified based on the 
categorical perception and a deviation between the color picture data and a representative color of a category to which 
the color picture data belong. 

Accordingly, with the color picture processing apparatus, since color changing processing can be realized only based 
5 on determination regarding a code of a color of picture data (whether or not the color is the same as the designated 
color) without the necessity of extraction of the color of a body, the color picture processing method is advantageous in 
that calculation processing for changing a vector in a color space is unnecessary and the processing time for changing 
a color is reduced as much, and high speed processing conforming to the sensations of human beings can be performed. 

According to a yet further aspect of the present invention, there is provided a color picture processing method, which 
w comprises the steps of discriminating to color information of which one of a plurality of categories of color information 
classified based on categorical perception of human beings inputted color picture data belong, converting the color 
picture data so as to have the thus discriminated color information, and performing data compression processing of the 
color picture data after the conversion into the color information based on the categorical perception. 

Accordingly, with the color picture processing method, since data compression processing of color picture data after 
75 conversion into color information based on the categorical perception is performed, the amount of data can be further 
reduced. Such compressed data provides an advantage in that the capacity of a hard disk or a like storage medium 
required to store data can be reduced, and in transmission which makes use of a channel, the communication time can 
be reduced. 

According to a yet further aspect of the present invention, there is provided a color picture processing apparatus, 
20 comprising color picture data inputting means for inputting color picture data, category discrimination means for discrim- 
inating to color information of which one of a plurality of categories of color information classified based on categorical 
perception of human beings the color picture data inputted from the color picture data inputting means belong, picture 
data conversion means for converting the color picture data so as to have the color information discriminated by the 
category discrimination means, and data compression means for performing data compression processing of the color 
25 picture data after the conversion into the color information based on the categorical perception by the picture data 
conversion means. 

Accordingly, with the color picture processing apparatus, since data compression processing of color picture data 
after conversion into color information based on the categorical perception is performed, the amount of data can be 
further reduced. Such compressed data provides an advantage in that the capacity of a hard disk or a like storage 
30 medium required to store data can be reduced, and in transmission which makes use of a channel, the communication 
time can be reduced. 

According to a yet further aspect of the present invention, there is provided a color picture processing method, which 
comprises the steps of discriminating to color information of which one of a plurality of categories of color information 
classified based on categorical perception of human beings inputted color picture data belong, converting the color 

35 picture data so as to have the thus discriminated color information, and converting the color picture data after the con- 
version into the color information based on the categorical perception into picture displayable data, which can be inputted 
to picture displaying means using means for indicating a corresponding relationship between the color information based 
on the categorical perception and such picture displayable data. 

Accordingly, with the color picture processing method according to the present invention, since it is first discriminated 

40 to color information of which one of a plurality of categories of color information classified based on categorical perception 
of human beings inputted color picture data belong and then the color picture data are converted so as to have the thus 
discriminated color information, whereafter the color picture data after the conversion into the color information based 
on the categorical perception are converted into picture displayable data as primary color information, which can be 
inputted to the picture displaying means using the means for incficating a corresponding relationship between the color 

45 information based on the categorical perception and such picture displayable data, a picture which conforms to the 
sensations of human beings to colors can be represented with small data for approximately 12 colors (4 bits), and as a 
result, there is an advantage in that comparing with a display of, for example, 256 colors, the amount of data can be 
reduced to one half, and the memory for display data can be reduced very much. 

According to a yet further aspect of the present invention, there is provided a color picture processing apparatus, 

so comprising color picture data inputting means for inputting color picture data, category discrimination means for discrim- 
inating to color information of which one of a plurality of categories of color information classified based on categorical 
perception of human beings the color picture data inputted from the color picture data inputting means belong, picture 
data conversion means for converting the color picture data so as to have the color information discriminated by the 
category discrimination means, and picture displayable data conversion means for converting the color picture data after 

55 the conversion into the color information based on the categorical perception by the picture data conversion means into 
picture displayable data, which can be inputted to picture displaying means, using means for indicating a corresponding 
relationship between the color information based on the categorical perception and such picture displayable data. 

Accordingly, with the color picture processing apparatus. RGB data approximately equivalent to an original picture 
can be obtained, and a picture of a high picture quality can be displayed. Further, where such conversion is performed 
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making use of a lookup table for which an IC memory or the like is used, high speed processing for reduction in number 
of colors can be performed. 

According to a yet further aspect of the present invention, there is provided a color picture processing apparatus, 
comprising color picture data inputting means for inputting color picture data, category discrimination means for discrim- 

s inating to color information of which one of a plurality of categories of color information classified based on categorical 
perception of human beings the color picture data inputted from the color picture data inputting means belong, picture 
data conversion means for converting the color picture data so as to have the color information discriminated by the 
category discrimination means, region extraction means for specifying and extracting, from the color picture data after 
conversion into the color information based on the categorical perception, a partial region of a picture constructed from 

10 the color picture data after the conversion, color changing means for changing, based on the color picture data after the 
conversion into the color information based on the categorical perception by the picture data conversion means, some 
or all of colors of a picture constructed from the color picture data after the conversion, data compression means for 
performing data compression processing of the color picture data after the conversion into the color information based 
on the categorical perception by the picture data conversion means, and picture displayable data conversion means for 

is converting the color picture data after the conversion into the color information based on the categorical perception by 
the picture data conversion means into picture displayable data, which can be inputted to picture displaying means, 
using means for indicating a corresponding relationship between the color information based on the categorical percep- 
tion and such picture displayable data. 

With the color picture processing apparatus, since a color of color picture data is discriminated based on the cate- 

20 gorical perception of human beings, the amount of picture data can be reduced without degrading the picture quality in 
accordance with the sensations of human beings. Further, extraction of a body, a change of a color, reduction of the 
number of colors and so forth can be performed simply. The color picture processing apparatus is advantageous also 
in that the amount of data can be further reduced without degrading the picture quality by making use of a data com- 
pression technique such as the JPEG. 

25 According to a yet further aspect of the present invention, there is provided a color picture processing method 
wherein a particular color in a picture constructed from color picture data is designated to extract an arbitrary body region 
and a color of the arbitrary body region in the picture is derived and changed to an aimed color designated separately, 
comprising the steps of detecting to color information of which one of a plurality of categories of color information clas- 
sified based on categorical perception of human beings the designated color or the derived body color or else the aimed 

30 color belongs, detecting to color information of which one of the plurality of categories of color information classified 
based on the categorical perception of human beings the color picture data of the body region before or after the color 
change belong, discriminating whether categories of the instructed color, the body color or the aimed color and the color 
picture data are same as or different from each other, and performing processing of requesting, based on a result of the 
discrimination, an operator for a change of the color picture data or for display of the result. 

35 Accordingly, with the color picture processing method, since color picture data before or after a color change can 
be changed based on a result of discrimination in category, there is an advantage in that the picture quality can be 
improved by reducing noise in data of a body picture of an object of the color change or by reducing noise expanded by 
the color change. 

According to a yet further aspect of the present invention, there is provided a color picture processing apparatus, 
40 comprising a memory for storing inputted color picture data, body region extraction means for extracting an arbitrary 
body region of a picture constructed from the inputted color picture data designating a color, body color detection means 
for detecting a body color of the body, aimed color designation means for designating an aimed color for a color change 
of the body, color changing means for changing the color of the body into the aimed color for a color change, first category 
discrimination means for discriminating to color information of which one of a plurality of categories of color information 
45 classified based on categorical perception of human beings the designated color or the derived body color or else the 
aimed color belongs, second category discrimination means for discriminating to color information of which one of the 
plurality of categories of color information classified based on the categorical perception of human beings the color 
picture data of the body region before or after the color change belongs, category difference discrimination means for 
discriminating whether the category of the designated color, the body color or the aimed color and the category of the 
so color picture data discriminated by the first category discrimination means and the second category discrimination 
means, respectively, are same as or different from each other, and picture data changing means for changing the color 
picture data before or after the color change based on a result of the discrimination by the category difference discrim- 
ination means. 

Accordingly, with the color picture processing apparatus, since color picture data before or after a color change can 
55 be changed based on a result of discrimination in category, there is an advantage in that the picture quality can be 
improved by reducing noise in data of a body picture of an object of the color change or by reducing noise expanded by 
the color change. 

According to a yet further aspect of the present invention, there is provided a color picture processing method 
wherein a color of an arbitrary body region in a color picture is changed by changing a position of data indicating the 
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body region in a color space, which comprises the steps of discriminating whether data indicating the body region before 
and after a color change belong, when the data are converted into a plurality of colors classified based on categorical 
perception of human beings, to the same category or to different categories, and changing the positions of the data in 
the color space based on a result of the discrimination to change the color of the body 

With the color picture processing method, since the positions of data in a color space can be changed based on a 
result of discrimination by the category difference discrimination means, even when the color of the body which is influ- 
enced by unexpected reflection or the like is to be changed, the effect of the reflection can be maintained. Consequently, 
there is an advantage in that a natural result conforming to the sensations of human beings can be obtained. 

According to a yet further aspect of the present invention, there is provided a color picture processing apparatus 
wherein a color of an arbitrary body region in a color picture is changed by changing a position of data indicating the 
body region in a color space, comprising a memory for storing body region data, body color detection means for detecting 
a body color of the body data, aimed color designation means for designating an aimed color for a color change of the 
body data, category discrimination means for discriminating to color information of which one of a plurality of categories 
of color information classified based on categorical perception of human beings the body color data indicating the body 
region before and after a color change and the aimed color data belong, and data conversion means for converting the 
data so as to have the color information discriminated by the category discrimination means. 

With the color picture processing apparatus, since the positions of data in a color space can be changed based on 
a result of discrimination by the category difference discrimination means, even when the color of the body which is 
influenced by unexpected reflection or the like is to be changed, the effect of the reflection can be maintained. Conse- 
quently, there is an advantage in that a natural result conforming to the sensations of human beings can be obtained. 

Further objects, features and advantages of the present invention will become apparent from the following detailed 
description when read in conjunction with the accompanying drawings in which like parts or elements are denoted by 
like reference characters. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

FIGS. 1 to 3 are block diagrams illustrating different aspects of the present invention; 

FIG. 4 is a block diagram of a color picture processing apparatus showing a first preferred embodiment of the present 
30 invention; 

FIGS. 5(a) and 5(b), 6(a) and 6(b), and 7(a) and 7(b) are diagrammatic views showing different examples of clas- 
sification on an xy chromaticity diagram; 

35 FIGS. 8(a) to 8(c) are diagrammatic views showing examples of a representation of picture data employed in the 
color picture processing apparatus shown in FIG. 4; 

FIGS. 9(a) and 9(b) are diagrammatic views illustrating a procedure of deciding a category when picture data in the 
color picture processing apparatus shown in FIG. 4 comes in a boundary region of a category; 

40 

FIG. 10 is a flow chart illustrating a procedure of specifying and extracting a partial region of a picture constructed 
from color picture data in the color picture processing apparatus shown in FIG. 4; 

FIGS. 1 1 and 12 are a diagrammatic view and a flow chart, respectively, illustrating a process of changing some or 
45 all colors of a picture constructed from color picture data in the color picture processing apparatus shown in FIG. 4; 

FIG. 1 3 is a flow chart illustrating a compression procedure of the color picture processing apparatus shown in FIG. 4; 

FIGS. 1 4(a) and 1 4(b) are diagrammatic views illustrating a procedure of converting data in the color picture process- 
so ing apparatus shown in FIG. 4 into RGB data or like data to be used for displaying on a display unit or a like apparatus 
by means of a displaying data conversion section; 

FIG. 15 is a block diagram of another color picture processing apparatus showing a second preferred embodiment 
of the present invention; 

55 

FIG. 1 6 is a flow chart illustrating processing operation of the color picture processing apparatus shown in FIG. 1 5; 

FIGS. 17 and 18(a) to 18(c) are a flow chart and diagrammatic views, respectively, illustrating a first picture data 
conversion process before a color change in the color picture processing apparatus shown in FIG. 15; 
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FIGS. 19 and 20(a) to 20(c) are a flow chart and diagrammatic views, respectively, illustrating a second picture data 
conversion process before a color change in the color picture processing apparatus shown in FIG. 15; 

FIGS. 21 and 22(a) to 22(c) are a flow chart and diagrammatic views, respectively, illustrating a first picture data 
5 conversion process after a color change in the color picture processing apparatus shown in FIG. 15; 

FIGS. 23 and 24(a) to 24(c) are a flow chart and diagrammatic views, respectively, illustrating a second picture data 
conversion process after a color change in the color picture processing apparatus shown in FIG. 15; 

10 FIG. 25 is a block diagram of a further color picture processing apparatus showing a third preferred embodiment of 
the present invention; 

FIG. 26 is a flow chart illustrating a color changing procedure of the color picture processing apparatus shown in 
FIG. 25; 

15 

FIG. 27 is a flow chart illustrating another color variation procedure performed in accordance with a result of color 
category comparison by a color variation section of the color picture processing apparatus shown in FIG. 25; 

FIGS. 28(a) and 28(b) are diagrammatic views showing different color spaces represented in the brightness, the 
20 saturation and the hue in the color picture processing apparatus shown in FIG. 25; 

FIGS. 29(a) and 29(b) are diagrammatic views illustrating rotationally moving processes for data in accordance with 
the categories of a body color and an aimed color in the color picture processing apparatus shown in FIG. 25; 

25 FIGS. 30(a) and 30(b) are diagrammatic views illustrating a rotationally moving process for body data in the color 
picture processing apparatus shown in FIG. 25; 

FIGS. 31 (a) and 31 (b) are diagrammatic views illustrating a decompression or compression process for body data 
in the color picture processing apparatus shown in FIG. 25; 

30 

FIGS. 32(a) and 32(b) are diagrammatic views illustrating a reversing process for body data in the color picture 
processing apparatus shown in FIG. 25; and 

FIG. 33 is a diagrammatic view illustrating a color change based on a reflection model. 

35 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
A. Aspects of the Invention 

40 First, several aspects of the present invention will be described with reference to the drawings. Referring first to FIG. 
1 , there is shown a color picture processing apparatus according to a first aspect of the present invention. In the color 
picture processing apparatus shown, it is first discriminated to color information of which one of a plurality of categories 
of color information classified based on categorical perception of human beings inputted color picture data belong, and 
then the color picture data are converted so as to have the thus discriminated color information, and thereafter, suc- 

45 ceeding picture processing is performed using the color picture data after the conversion into the color information based 
on the categorical perception. 

Or, a color of picture data is represented as a color code representing one of a plurality of colors classified based 
on categorical perception of human beings as a plurality of classified colors and a deviation between the color of the 
picture data and a representative color of a color category to which a color represented by data including the color code 

so information belongs, and thereafter, succeeding picture processing is performed using the thus represented color. 

Here, the deviation may be data representative of a direction of the color of the picture data from the representative 
color of the color category or data representative of a distance of the color of the picture data from the representative 
color of the color category. 

The color picture processing apparatus shown in FIG. 1 includes color picture data inputting means 1 for inputting 
55 color picture data. 

The color picture processing apparatus further includes category discrimination means 2 for discriminating to color 
information of which one of a plurality of categories of color information classified based on categorical perception of 
human beings color picture data inputted from the color picture data inputting means 1 belong. 
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The color picture processing apparatus further includes picture data conversion means 3 for converting color picture 
data so as to have color information discriminated by the category discrimination means 2. 

The color picture processing apparatus further includes region extraction means 4 for specifying and extracting, 
from color picture data after conversion into color information based on the categorical perception by the picture data 
s conversion means 3, a partial region of a picture constructed from the color picture data after the conversion. 

The color picture processing apparatus further includes color changing means 5 for changing, based on color picture^ 
data after conversion into color information based on the categorical perception by the picture data conversion means 
3, some or all of colors of a picture constructed from the color picture data after the conversion. 

The color picture processing apparatus further includes data compression means 6 for performing data compression 
w processing of color picture data after conversion into color information based on the categorical perception by the picture 
data conversion means 3. 

The color picture processing apparatus further includes picture displayable data conversion means 7 for converting 
color picture data after conversion into color information based on the categorical perception by the picture data con- 
version means 3 into picture displayable data, which can be inputted to picture displaying means 8, using means 9 for 
is indicating a corresponding relationship between the color information based on the categorical perception and such 
picture displayable data. 

The picture data conversion means 3 may include means for converting color picture data using a code of a color 
classified based on the categorical perception of human beings, means for converting color picture data using combi- 
nation information of a code of a color classified based on the categorical perception and a deviation between the color 

20 picture data and a representative color of a category to which the color picture data belong, or means for converting 
color picture data using combination information of a code of a color classified based on the categorical perception and 
a parameter representing at least one of the brightness and the clearness. 

Meanwhile, the category discrimination means 2 may discriminate, when color picture data of an object picture 
element belongs to a boundary region of a category of a color, to color information of which one of the categories the 

25 color picture data belong, based on a relationship to category colors of picture elements around the object picture element 
of the color picture data, or may detect, when color picture data of an object picture element belongs to a boundary 
region of a category of the color, categories in color of the picture elements around the object picture element of the 
color picture data, count the numbers of picture elements of same categories and discriminate that one of the categories 
whose number of picture elements is the greatest among the counted numbers as the category of the color picture data. 

30 In the color picture processing apparatus according to the first aspect of the present invention described above with 
reference to FIG. 1 , when color picture are inputted, it is first discriminated to color information of which one of a plurality 
of categories of color information classified based on categorical perception of human beings the inputted color picture 
data belong, and then the color picture data are converted so as to have the thus discriminated color information, and 
thereafter, succeeding picture processing is performed using the color picture data after the conversion into the color 

35 information based on the categorical perception. 

Or, a color of picture data may be represented as a color code representing one of a plurality of colors classified 
based on categorical perception of human beings and a deviation between the color of the picture data and a repre- 
sentative color of a color category to which a color represented by data including the color code information belongs, 
and thereafter, succeeding picture processing may be performed using the thus represented color. 

40 Here, the deviation may be data representative of a direction of the color of the picture data from the representative 
color of the color category or data representative of a distance of the color of the picture data from the representative 
color of the color category. 

More particularly, when color picture data are inputted from the color picture data inputting means 1 of the color 
picture processing apparatus, the category discrimination means 2 discriminates to color information of which bne of a 
45 plurality of categories of color information classified based on categorical perception of human beings the colc^r picture 
data inputted from the color picture data inputting means 1 belong. 

Then, the picture data conversion means 3 converts the color picture data so as to have color information discrim- 
inated by the category discrimination means 2, and the region extraction means 4 specifies and extract, from the color 
picture data after the conversion into the color information based on the categorical perception by the picture data 
so conversion means 3, a partial region of a picture constructed from the color picture data after the conversion. 

Further, the color changing means 5 changes, based on the color picture data after the conversion into the color 
information based on the categorical perception by the picture data conversion means 3, some or all of colors of a picture 
constructed from the color picture data after the conversion. 

Further, the data compression means 6 performs data compression processing of the color picture data after the 
55 conversion into the color information based on the categorical perception by the picture data conversion means 3. 

Then, the picture displayable data conversion means 7 converts the color picture data after the conversion into the 
color information based on the categorical perception by the picture data conversion means 3 into picture displayable 
data, which can be inputted to the picture displaying means 8, using the means 9 for indicating a corresponding rela- 
tionship between the color information based on the categorical perception and such picture displayable data. 
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Further, the picture data conversion means 3 can convert the color picture data using a code of a color classified 
based on the categorical perception of human beings, convert the color picture data using combination information of 
a code of a color classified based on the categorical perception and a deviation between the color picture data and a 
representative color of a category to which the color picture data belong, or convert the color picture data using combi- 
5 nation information of a code of a color classified based on the categorical perception and a parameter representing at 
least one of the brightness and the clearness to convert the color of the picture data based on the perception of human 
beings. 

Meanwhile, the category discrimination means 2 can discriminate, when color picture data of an object picture 
element belongs to a boundary region of a category of a color, to color information of which one of the categories the 

10 color picture data belong, based on a relationship to category colors of picture elements around the object picture element 
of the color picture data, or can detect, when color picture data of an object picture element belongs to a boundary 
region of a category of the color, categories in color of the picture elements around the object picture element of the 
color picture data, count the numbers of picture elements of same categories and discriminate that one of the categories 
whose number of picture elements is the greatest among the counted numbers as the category of the color picture data. 

15 With the color picture processing apparatus according to the aspect of the present invention described above, since 
a color of color picture data is discriminated based on the categorical perception of human beings, the amount of picture 
data can be reduced without degrading the picture quality in accordance with the sensations of human beings. Further, 
extraction of a body, a change of a color, reduction of the number of colors and so forth can be performed simply. The 
color picture processing apparatus is advantageous also in that the amount of data can be further reduced without 

20 degrading the picture quality by making use of a data compression technique such as the JPEG. 

Further, since a color as picture data can be represented in four bits in the minimum by the picture data conversion 
means 3, colors conforming to the sensations of human beings can be represented with an amount of data reduced to 
1/6 to the utmost comparing with that of the RGB representation in which picture data are represented in 24 bits in which 
individual 8 bits represent different colors. Consequently, handling of a picture with a higher efficiency can be realized. 

25 Furthermore, since data can be converted by referring to a lookup table or the like in which the relationships among 
picture data and colors based on the categorical perception, representative colors of the individual categories, and 
deviations (direction, distance and so forth) from the representative colors are stored, the conversion processing can 
be performed at a higher speed than that by conversion which is based on software or the like, and consequently, a 
remarkable increase in processing speed can be anticipated. 

30 Further, in the color picture processing apparatus, when color picture data of an original picture element belongs 
to a boundary of a category of a color, the category discrimination means 2 investigates categories of picture elements 
around the original picture element and determines a color which appears most frequently at the picture elements around 
the original picture elements as the color of the object of investigation. Consequently, a color in a boundary region which 
cannot be classified readily when picture data are represented using colors based on the categorical perception can be 

35 determined with certainty. As a result, picture data of a high picture quality in accordance with which no such situation 
that a different color such as a color of noise appears in one body occurs can be obtained. 

Further, in the color picture processing apparatus, since region extraction processing of a body can be performed 
only by determination regarding a code of a color of picture data (whether or not the color is the same as a designated 
color), processing conforming to the sensations of human beings can be performed at a higher speed than that by 

40 another method which is based on manual operation or makes use of the hue. 

Furthermore, in the color picture processing apparatus, since color changing processing can be realized only based 
on determination regarding a code of a color of picture data (whether or not the color is the same as the designated 
color) without the necessity of extraction of the color of a body, the color picture processing apparatus is advantageous 
also in that calculation processing for changing a vector in a color space is unnecessary and the processing time for 

45 changing a color is reduced as much, and high speed processing conforming to the sensations of human beings can 
be performed. 

Further, in the color picture processing apparatus, since data compression processing of color picture data after 
conversion into color information based on the categorical perception is performed, the amount of data can be further 
reduced. Such compressed data provides an advantage in that the capacity of a hard disk or a like storage medium 
so required to store data can be reduced, and in transmission which makes use of a channel, the communication time can 
be reduced. 

Meanwhile, according to a color picture processing method according to the present invention, since it is first dis- 
criminated to color information of which one of a plurality of categories of color information classified based on categorical 
perception of human beings inputted color picture data belong and then the color picture data are converted so as to 
55 have the thus discriminated color information, whereafter the color picture data after the conversion into the color infor- 
mation based on the categorical perception are converted into picture displayable data, which can be inputted to the 
picture displaying means 8 using the means 9 for indicating a corresponding relationship between the color information 
based on the categorical perception and such picture displayable data, a picture which conforms to the sensations of 
human beings to colors can be represented with small data for approximately 12 colors (4 bits), and as a result, there 
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is an advantage in that, comparing with a display of, for example, 256 colors, the amount of data can be reduced to one 
half, and the memory for display data can be reduced very much. 

Further, according to the color picture processing apparatus of the aspect of the present invention described above, 
since it comprises the color picture data inputting means 1 for inputting color picture data, the category discrimination 

5 means 2 for discriminating to color information of which one of a plurality of categories of color information classified 
based on categorical perception of human beings the color picture data inputted from the color picture data inputting 
means 1 belong, the picture data conversion means 3 for converting the color picture data so as to have the color 
information discriminated by the category discrimination means 2, and the picture displayable data conversion means 
7 for converting the color picture data after the conversion into the color information based on the categorical perception 

w by the picture data conversion means 3 into picture displayable data, which can be inputted to the picture displaying 
means 8, using the means 9 for indicating a corresponding relationship between the color information based on the 
categorical perception and such picture displayable data, RGB data approximately equivalent to an original picture can 
be obtained, and a picture of a high picture quality can be displayed. Further, where such conversion is performed making 
use of a lookup table for which an IG memory or the like is used, high speed processing for reduction in number of colors 

is can be performed. 

Referring now to FIG. 2, there is shown in block diagram a color picture processing apparatus according to a second 
aspect of the present invention. The color picture processing apparatus includes a memory 11 for storing inputted color 
picture data, body region extraction means 1 2 for extracting an arbitrary body region of a picture constructed from inputted 
color picture data designating a color, body color detection means 1 3 for detecting a body color of a body, aimed color 

20 designation means 14 for designating an aimed color for a color change of a body, and color changing means 15 for 
changing the color of a body into an aimed color for a color change. 

The color picture processing apparatus further includes first category discrimination means 16 for discriminating to 
color information of which one of a plurality of categories of color information classified based on categorical perception 
of human beings a designated color or a derived body color or an aimed color belongs. 

25 The color picture processing apparatus further includes second category discrimination means 1 7 for discriminating 
to color information of which one of the plurality of categories of color information classified based on the categorical 
perception of human beings color picture data of a body region before or after a color change belongs. 

The color picture processing apparatus further includes category difference discrimination means 18 for discrimi- 
nating whether the category of a designated color, a body color or an aimed color and the category of color picture data 

30 discriminated by the first category discrimination means 1 6 and the second category discrimination means 1 7, respec- 
tively, are same as or different from each other. 

The color picture processing apparatus further includes picture data changing means 1 9 for changing color picture 
data before or after a color change based on a result of discrimination by the category difference discrimination means 1 8. 
When discrimination by the category difference discrimination means 18 of whether the categories of a body color 

35 and color picture data before a color change are same as or different from each other proves that the color picture data 
are partially different in category from the body color, the picture data changing means 19 may convert those color 
picture data which are different in category from the body color into color picture data of the same category as that of 
the body color. Then, when the color picture data which are different in category from the body color are converted into 
the color picture data of the same category as that of the body color, the picture data changing means 19 may change 

40 those color picture data so as to be positioned on a boundary of the category of the body color. 

Or, when discrimination by the category difference discrimination means 18 of whether the categories of a body 
color and color picture data before a color change are same as or different from each other proves that the color picture 
data are partially different in category from the body color, the picture data changing means 19 may change all of the 
color picture data into color picture data of the same category as that of the body color. Then, when all of the color 

45 picture data are changed into color picture data of the same category as that of the body color, the picture data changing 
means 19 may first detect a straight line interconnecting the body color and each of the color picture data in a color 
space and then detect a crossing point between the straight line and a boundary of the category of the body color and 
also detect a distance between the crossing point and the color picture data, whereafter the picture data changing means 
19 changes the positions of the color picture data in the color space in accordance with the positions of the body color 

so and the individual color picture data so that that one of the color picture data whose distance is greatest among the 
distances may be included in the same category as that of the body color. 

Or else, when discrimination by the category difference discrimination means 1 8 of whether the categories of an 
aimed color and color picture data after a color change are same as or different from each other proves that the color 
picture data are partially different in category from the aimed color, the picture data changing means 19 may change 

55 the color picture data which are different in category from the aimed color into color picture data of the same category 
as that of the aimed color. Then, when the color picture data which are different in category from the aimed color are 
converted into the color picture data of the same category as that of the aimed color, the picture data changing means 
19 may change the color picture data so as to be positioned on a boundary of the category of the body color. 
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Otherwise, when discrimination by the category difference discrimination means 18 of whether the categories of an 
aimed color and color picture data after a color change are same as or different from each other proves that the color 
picture data are partially different in category from the aimed color, the picture data changing means 19 may change all 
of those color picture data which are different in category from the aimed color into color picture data of the same category 

5 as that of the aimed color. Then, when alt of the color picture data are changed into color picture data of the same 
category as that of the aimed color, the picture data changing means 19 may first detect a straight line interconnecting 
the aimed color and each of those color picture data in a color space and then detect a crossing point between the 
straight line and a boundary of the category of the body color and also detect a distance between the crossing point 
and the color picture data, whereafter the picture data changing means 19 changes the positions of the color picture 

10 data in the color space in accordance with the positions of the aimed color and the individual color picture data so that 
that one of the color picture data whose distance is greatest among the distances may be included in the same category 
as that of the aimed color. 

In color picture processing apparatus according to the second aspect of the present invention described above with 
reference to FIG. 2, inputted color picture data are stored into the memory 1 1 , and the body region extraction means 

is 12 extracts an arbitrary body region of a picture constructed from the inputted color picture data designating a color. 

Meanwhile, the body color detection means 13 detects a body color of the body, and the aimed color designation 
means 14 designates an aimed color for a color change of the body. Consequently, the color changing means 15 changes 
the color of the body into the designated aimed color. 

Further, the first category discrimination means 16 discriminates to color information of which one of a plurality of 

20 categories of color information classified based on the categorical perception of human beings the designated color, the 
derived body color or the aimed color belongs. Meanwhile, the second category discrimination means 1 7 discriminates 
to color information of which one of the plurality of categories of color information classified based on the categorical 
perception of human beings the color picture data of the body region before or after the color change belongs. 

Then, the category difference discrimination means 18 discriminates whether the category of the designated color, 

25 the body color or the aimed color and the category of the color picture data discriminated by the first category discrim- 
ination means 16 and the second category discrimination means 17, respectively, are same as or different from each 
other. The picture data changing means 19 thus changes the color picture data before or after the color change based 
on a result of the discrimination by the category difference discrimination means 18. 

Further, when the discrimination by the category difference discrimination means 1 8 of whether the categories of 

30 the body color and the color picture data before the color change are same as or different from each other proves that 
the color picture data are partially different in category from the body color, the picture data changing means 19 may 
convert those color picture data which are different in category from the body color into color picture data of the same 
category as that of the body color. Further, when the color picture data which are different in category from the body 
color are converted into the color picture data of the same category as that of the body color, the picture data changing 

35 means 19 may change those color picture data so as to be positioned on a boundary of the category of the body color. 
Or, when the discrimination by the category difference discrimination means 18 of whether the categories of the 
body color and the color picture data before the color change are same as or different from each other proves that the 
color picture data are partially different in category from the body color, the picture data changing means 1 9 may change 
all of the color picture data into color picture data of the same category as that of the body color. Further, when all of 

40 the color picture data are changed into color picture data of the same category as that of the body color, the picture data 
changing means 19 may first detect a straight line interconnecting the body color and each of the color picture data in 
a color space and then detect a crossing point between the straight line and a boundary of the category of the body 
color and also detect a distance between the crossing point and the color picture data, whereafter the picture data 
changing means 1 9 changes the positions of the color picture data in the color space in accordance with the positiohs 

45 of the body color and the individual color picture data so that that one of the color picture data whose distance is greatest 
among the distances may be included in the same category as that of the body color. 

Or else, when the discrimination by the category difference discrimination means 18 of whether the categories of 
the aimed color and the color picture data after the color change are same as or different from each other proves that 
the color picture data are partially different in category from the aimed color, the picture data changing means 19 may 

so change the color picture data which are different in category from the body color into color picture data of the same 
category as that of the aimed color. Then, when the color picture data which are different in category from the aimed 
color are converted into the color picture data of the same category as that of the aimed color, the picture data changing 
means 19 may change the color picture data so as to be positioned on a boundary of the category of the body color. 
Otherwise, when the discrimination by the category difference discrimination means 18 of whether the categories 

55 of the aimed color and the color picture data after the color change are same as or different from each other proves that 
the color picture data are partially different in category from the aimed color, the picture data changing means 19 may 
change all of those color picture data which are different in category from the aimed color into color picture data of the 
same category as that of the aimed color. Further, when all of the color picture data are changed into color picture data 
of the same category as that of the aimed color, the picture data changing means 19 may first detect a straight line 
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interconnecting the aimed color and each of those color picture data in a color space and then detect a crossing point 
between the straight line and a boundary of the category of the body color and also detect a distance between the 
crossing point and the color picture data, whereafter the picture data changing means 19 changes the positions of the 
color picture data in the color space in accordance with the positions of the aimed color and the individual color picture 

5 data so that that one of the color picture data whose distance is greatest among the distances may be included in the 
same category as that of the aimed color. 

Accordingly, with the color picture processing apparatus according to the second aspect of the present invention, 
since color picture data before or after a color change can be changed based on a result of discrimination in category, 
there is an advantage in that the picture quality can be improved by reducing noise in data of a body picture of an object 

10 of the color change or by reducing noise expanded by the color change. 

Further, with the color picture processing apparatus, since color picture data before a color change can be changed 
by the picture data changing means 19, data of irregular colors arising from noise in the body can be reduced with a 
minimum amount of a change of the data, and as a result, such a noise as will degrade the picture quality after the color 
change does not appear and a color change of a high quality can be realized. 

is Furthermore, with the color picture processing apparatus, since color picture data before a color change can be 

changed by the picture data changing means 19, those data outside a category can be eliminated without any change 
in relative positional relationship of the entire picture data, and resulted data do not include such data as may possibly 
have a bad influence on the picture quality as a result of the color change. Accordingly, the influence of the change of 
data upon the picture quality can be reduced remarkably. 

20 Further, with the color picture processing apparatus, since color picture data after a color change can be changed 
by the picture data changing means 1 9, data of irregular colors arising from noise in the body after the color change can 
be removed with a minimum amount of a change of the data, and as a result, the picture quality after the color change 
can be improved. 

Furthermore, with the color picture processing apparatus, since color picture data after a color change can be 
25 changed by the picture data changing means 19, those data outside a category can be eliminated without any change 
in relative positional relationship of the entire picture data, and resulted data do not include such data as may possibly 
have a bad influence on the picture quality as a result of the color change. Accordingly, the influence of the change of 
data upon the picture quality can be reduced remarkably. 

Referring now to FIG. 3, there is shown in block diagram a color picture processing apparatus according to a third 
30 preferred embodiment of the present invention. In the a color of an arbitrary body region in a color picture is changed 
by changing a position of data indicating the body region in a color space. 

The color picture processing apparatus includes a memory 21 for storing body region data, body color detection 
means 22 for detecting a body color of body data, aimed color designation means 23 for designating an aimed color for 
a color change of body data, and category discrimination means 24 for discriminating to color information of which one 
35 of a plurality of categories of color information classified based on categorical perception of human beings body color 
data indicating the body region before and after a color change and aimed color data belong. 

The color picture processing apparatus further includes data conversion means 25 for converting data so as to have 
color information discriminated by the category discrimination means 24. 

The color picture processing apparatus further includes category difference discrimination means 26 for discrimi- 
40 nating whether or not data obtained by conversion by the data conversion means 25 and indicating a body region before 
and after a color change belong to the same category. 

The color picture processing apparatus further includes color changing means 27 for changing the position of data 
in a color space based on a result of discrimination by the category difference discrimination means 26 to change the 
color of a body. 

45 The category difference discrimination means 26 may include derived color category detection means for detecting 
a category of a derived color derived from a body region, aimed color category detection means for detecting a category 
of an aimed color designated as a color to be aimed for a color change, and category comparison means for comparing 
the categories of a derived color and an aimed color detected by the derived color category detection means and the 
aimed color category detection means with each other. 

so The color space may be constructed as a space which can be represented in brightness, saturation and hue, and 
the color changing means 27 may include means for changing a value of at least one of the brightness, the saturation 
and the hue. 

In this instance, the color changing means 27 may include means for rotationally moving, when the categories of 
the body color and the aimed color are same as each other, a distribution of the data in the color space around a center 
55 provided by a straight line representing achromatic colors while maintaining a positional relationship of the data with 
respect to a plane which includes the straight line representing the achromatic colors and a point of the derived color, 
and means for rotationally moving, when the categories of the body color and the aimed color are different from each 
other, the distribution of the data in the color space around the straight line while reversing the distribution of the data 
with respect to the plane. 
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Further, in this instance, the color changing means 27 may include means for performing data decompression 
processing or data compression processing of data in a color space in the direction of the brightness to change the 
value in brightness, means for performing data decompression processing or data compression processing of data in 
a color space in the direction of the saturation to change the value in saturation, or means for performing data rotating 

5 processing of data in a color space around a straight line representing achromatic colors to change the value in hue. 

In the color picture processing apparatus according to the third aspect of the present invention described herein- 
above with reference to FIG. 3 t the body color detection means 22 detects a body color of body data based on body 
region data stored in the memory 21 . Then, the category discrimination means 24 discriminates to color information of 
which one of a plurality of categories of color information classified based on categorical perception of human beings 

io the body color data from the body color detecting means 22 indicating the body region before and after a color change 
and aimed color data for a color change designated by the aimed color designation means 23 belong. 

Then, the data conversion means 25 converts the data so as to have color information discriminated by the category 
discrimination means 24, and the category difference discrimination means 26 discriminates whether or not the data 
obtained by the data conversion means 25 and indicating the body region before and after the color change belong to 

15 the same category. 

Consequently, the color changing means 27 changes the position of the data in the color space based on a result 
of the discrimination by the category difference discrimination means 26 to change the color of the body. In short, the 
color of an arbitrary body region in a color picture is changed by changing the position of data indicating the body region 
in a color space. 

20 Further, in the category difference discrimination means 26, the derived color category detection means detects a 
category of a derived color derived from the body region, and the aimed color category detection means detects a 
category of the aimed color designated as a color to be aimed for a color change. Further, the category comparison 
means compares the categories of the derived color and the aimed color detected by the derived color category detection 
means and the aimed color category detection means with each other to discriminate whether the data indicating the 

25 body region before and after the color change belong to a same category. 

The color space may be constructed as a space which can be represented in brightness, saturation and hue, and 
the color changing means 27 may change the value of at least one of the brightness, the saturation and the hue. 

In particular, the color changing means 27 may rotationally move, when the categories of the body color and the 
aimed color are same as each other, the distribution of the data in the color space around a center provided by a straight 

30 line representing achromatic colors while maintaining the positional relationship of the data with respect to a plane which 
includes the straight line representing the achromatic colors and a point of the derived color, but rotationally move, when 
the categories of the body color and the aimed color are different from each other, the distribution of the data around 
the straight line while reversing the distribution of the data with respect to the plane. 

Further, in this instance, the color changing means 27 may perform data decompression processing or data com- 

35 pression processing of the data in the color space in the direction of the brightness to change the value in brightness, 
or perform data decompression processing or data compression processing of the data in that color space in the direction 
of the saturation to change the value in saturation, or else perform data rotating processing of the data in the color space 
around the straight line representing the achromatic colors to change the value in hue. 

With the color picture processing apparatus according to the third aspect of the present invention, since the positions 

40 of data in a color space can be changed based on a result of discrimination by the category difference discrimination 
means 26, even when the color of the body which is influenced by unexpected reflection or the like is to be changed, 
the effect of the reflection can be maintained. Consequently, there is an advantage in that a natural result conforming 
to the sensations of human beings can be obtained. 

45 B. Colors Based on Categorical Perception of Human Beings 

Before several embodiments of the present invention are described, colors based on categorical perception of 
human beings applied in the present invention will first be described with reference to FIGS. 5(a) to 7(b). 

In particular, colors based on categorical perception have been advocated in Uchikawa, "Categorical Perception 
so and Storage of Colors", Draft for the Seventh Color Optics Conference, 1990, pp.7-14, Uchikawa et al., "Categorical 
Color Name Regions of Color Space in Aperture Color and Surface Color Modes", Journal of the Illumination Society 
of Japan, Vol. 77, No. 6, 1993. and "Categorical Color Perception of Japanese Observers: Comparison with that of 
Americans" , Vision Res., 27, 1987, pp. 1825-1833. 

According to the colors based on categorical perception of human beings mentioned above, a human being per- 
55 ceives all colors in approximately 10 to 12 different or classified colors to the utmost. For example, a weak red, a deep 
red and a somewhat yellowish red are all classified and perceived as red by a human being. 

More particularly, FIGS. 5(a) to 7(b) illustrate different examples of classification on an xy chromaticity diagram at 
different brightness values (luminance 2 to 40 cd/m 2 ). The examples of classification illustrated in FIGS. 5(a) to 7(b) are 
based on sensations to all colors measured in examinations conducted for a plurality of human beings as testees. 
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Here, FIGS. 5(a), 5(b), 6(a), 6(b), 7(a) and 7(b) illustrate classifications on a chromaticity diagram when the lumi- 
nance is 2 cd/m2, 5 cd/rr^, 10 cd/m?, 20 cdJrrP, 30 cd/m2 and 40 cd/m2, respectively. 

Further, colors perceived by the testees, that is, red, pink, purple, blue, gray, white, green, yellow and orange, are 
represented by symbols of a blank square, a blank triangle, a blank diamond, a marked circle, a screened circle, a blank 
5 circle, a marked diamond, a screened square and a marked triangle, respectively. 

Furthermore, each symbol of a larger size represents that there is no difference in perception among the testees, 
that is, all of the testees have a same sensation to the color (coincidence degree: 100 %), and each symbol of a smaller 
size represents that the coincidence degree in perception of the color among the testees is 50 %, that is, one half of the 
testees have a same sensation to the color. 
io As seen from FIGS. 5(a) to 7(b), colors included in an area of a same symbol are all perceived as a single color by 
human beings. Further, it can be seen that sensations of human beings to colors exhibit little difference among individuals 
and exist stably. In this manner, it is experimentally proved that a human being feels all colors as such approximately 10 
to 12 different colors as mentioned above. 

Further, while each color exhibits a higher degree of clearness toward the outside of the triangle in each of FIGS. 
15 5(a) to 7(b), the clearness in color has little relationship to the perception in color of human beings as seen from FIGS. 
5(a) to 7(b). In other words, human beings are inclined to perceive colors having different degrees of clearness (colors 
near to the center and colors near to an outer periphery of the triangle in each of FIGS. 5(a) to 7(b)) as colors which 
belong to same categories. 

20 C. First Embodiment 

In the following, a first embodiment of the present invention will be described with reference to the drawings. 
cO. General Construction of Color Picture Processing Apparatus 

25 

Referring now to FIG. 4, there is shown in block diagram a color picture processing apparatus according to the first 
preferred embodiment of the present invention. The color picture processing apparatus shown includes a picture inputting 
apparatus (color picture data inputting means) 31 constituted from, for example, an image scanner for digitizing a natural 
picture of a color picture to obtain RGB data to input color picture data. 
30 The color picture processing apparatus further includes an input picture storage memory 32 for temporarily storing 
color picture data inputted from the picture inputting apparatus 31 . 

The color picture processing apparatus further includes a display memory 33 for receiving from the input picture 
storage memory 32 and storing color picture data to be displayed on a color display unit 34 such as a CRT (cathode ray 
tube). 

35 The color picture processing apparatus further includes a data representation conversion section (category discrim- 
ination means, picture data conversion means) 35 for receiving color picture data from the input picture storage memory 
32 and discriminating to color information of which one of categories of color information classified based on the cate- 
gorical perception of human beings the color picture data belong and further converting the color picture data so that 
they may have color information of the thus discriminated category. 

40 In particular, the data representation conversion section 35 discriminates each of the color picture data with regard 
to to which one of color codes of a plurality of categories of color information classified based on the categorical per- 
ception of human beings the color picture data belongs, and converts the color picture data into data represented by 
the color code of the category obtained by the discrimination and a deviation of the color o1 the color code from a 
representative color of the category or a like parameter. 

45 The color picture processing apparatus further includes a body extraction section (region extraction means) 37 for 
specifying and extracting a partial region of a picture to be constructed from color picture data after conversion into color 
information based on the categorical perception by the data representation conversion section 35. In other words, the 
body extraction section 37 can extract an arbitrary region of a body in a picture. 

The color picture processing apparatus further includes a color changing processing section (color variation means) 

so 38 for varying some or all colors of a picture constructed from color picture data after conversion into color information 
based on the categorical perception. In other words, the color changing processing section 38 can perform processing 
of combining an arbitrary body region extracted by the body extraction section 37 with another background picture or 
can vary the color of such arbitrary body region to an arbitrary color. 

The color picture processing apparatus further includes a data compression section (data compression means) 40 

55 for compressing color picture data after conversion into color information based on the categorical perception to reduce 
the data amount. 

The color picture processing apparatus further includes a display data conversion section (picture displayable data 
conversion means) 36 for receiving color picture data after conversion into color information based on the categorical 
perception and converting the color picture data into RGB data in accordance with information from a data storage 
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section 39. Further, the RGB data obtained by the conversion are displayed on the color display unit 34 through the 
display memory 33. 

The data storage section 39 mentioned above is constituted from a hard disk or the like and stores information 
representing a corresponding relationship between color information based on the categorical perception and picture 
5 displayable data (RGB data) which can be inputted to the color display unit 34 as well as color picture data after conversion 
into color information based on the categorical perception by the data representation conversion section 35, body region 
information extracted by the body extraction section 37, color change information from the color changing processing 
section 38 and data compression information from the data compression section 40. 

10 d. Discrimination of Color Information and Conversion of Color Picture Data 

Discrimination of color information based on the categorical perception of human beings with regard to color picture 
data and conversion of color picture data having discriminated color information, which are performed by the data rep- 
resentation conversion section 35, will be described below. 
15 A lookup table for detecting a color code of a category from XYZ values is produced, for example, in accordance 
with FIGS. 5(a) to 7(b). Then, picture data from the input picture storage memory 32 are converted from data of the RGB 
type into such XYZ and x, y data as seen in FIGS. 5(a) to 7(b) and discriminates a color of the categorical perception 
by referring to the values obtained by the conversion and the lookup table produced in advance as described above. 
It is to be noted that the conversions from RGB data into XYZ data and x, y data are performed making use of 
20 expressions (3) and (4) given below which are prescribed by the CIE (International Illumination Committee). 
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x = X/(X+Y+Z), y = Y/(X+Y+Z) (4) 

Further, the distance and the direction from a representative color of the category to the color in the XYZ color 
30 space is calculated. Such representative color is set to data whose color is regarded as the same color by almost all 
people (for example, data whose color is regarded as red by almost all people). For example, a representative color is 
set to data of a color in the proximity of the center of a region of a certain color shown in any of FIGS. 5(a) to 7(b). 

Or, colors prescribed in JIS, values of the colors in the XYZ color representation system (JIS-81 02 Color Names of 
Body Colors, JIS-Z8721 Color Representation Method Based on Three Attributes) and so forth can be used as names 
35 of red, blue and so forth. For example, according to a table of JIS, the value of red is, in terms of (Y, x, y), (12.0, 0.5385, 
0.31 29) (it is to be noted that this is data in the table of J IS which is nearest to the value 4R4/1 1 of 5R4/1 2). The following 
conversion expression is used to represent the data in the RGB data form: 
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Using a color code, a direction and a distance of color picture data obtained in such a manner as described above, 
45 the color picture data can be converted by representing them, for example, in such a manner as seen in FIGS. 8(a) to 8(c). 
In particular, FIGS. 8(a) to 8(c) illustrate examples of representation of picture data in accordance with region (cat- 
egorical color name region) division based on the categorical perception of human beings illustrated in FIGS. 5(a) to 7(b). 

More particular, FIG. 8(a) illustrates picture data represented by a code of only 4 bits (divided into 1 1 colors of red, 
green, yellow, brown, blue, purple, orange, pink, white, black and gray) in a categorical color name region. 
so Meanwhile, FIG. 8(b) illustrates picture data presented by a color code as well as deviation information (parameter) 
of a direction and deviation information (parameter) of a distance from a representative color of the category from object 
picture data. In the picture data illustrated in FIG. 8(b), both of the deviation information of the direction and the deviation 
information of the distance are constituted from 4 bits such that a picture element is represented by totaling 12 bits 
together with the color code. For example, the deviation information of the direction can be represented by 4 bits by 
55 dividing all directions into 16 directions. 

It is to be noted that, for the deviation information of the direction and the deviation information of the distance 
described hereinabove with reference to FIG. 8(b), for example, deviation information of a direction and deviation infor- 
mation of a distance from a representative color of a category to picture data represented in such an XYZ color repre- 
sentation system illustrated in FIG. 8(c) is used. 
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Accordingly, the data representation conversion section 35 can function not only as means for converting color 
picture data using codes of colors classified based on the categorical perception but also as means for converting color 
picture data using combination information of a code of a color and a deviation of a color picture from a representative 
color of a category to which the color picture belongs. 

5 

c2. Discrimination of Color Information of Picture Data in Boundary Region 

While picture data are converted into XYZ values by the data representation conversion section 35 as described 
hereinabove, where some picture data comes to a boundary region between categories in the XYZ color representation 

io system as shown, for example, in FIG. 9(a), categories of picture elements around the object picture element of the 
original picture are detected, and a category to which the object picture element of the picture data belongs is determined 
based on a result of the detection. 

In particular, it is assumed that the color in a same body region in a picture, that is, the color of an object picture 
element for detection, may be considered to be approximately same as the color of picture elements around the object 

is picture element as seen in FIG. 9(b). Accordingly, as seen from, for example, FIG. 9(b), colors of totaling nine picture 
elements including an object picture element and eight picture elements around the object picture element are detected, 
and one of the colors which appears most frequently is determined as the color of the object picture el ement for detection. 
For example, if the color of six picture elements is red, the color of two picture elements is yellow and the color of one 
picture element is gray, then the color of the object picture element is determined to be red. 

20 In other words, when color picture data of an object picture element belongs to a boundary region between cate- 
gories, the data representation conversion section 35 detects categories of colors of picture elements around the object 
picture element, counts the numbers of same categories and determines one of the categories, which exhibits the highest 
count value, as a category of the color picture data of the object picture element which belongs to the boundary region. 
It is to be noted that the discrimination method for color information of picture data described above with reference 

25 to FIGS. 9(a) and 9(b) can be applied also to removal of noise of picture data which may not be in a boundary region. 

c3. Extraction Processing of Body Regions 

Subsequently, processing performed by the body extraction section 37 to specify and extract a partial region of a 
30 picture constructed from color picture data after conversion will be descrtoed in detail with reference to a flow chart of 
FIG. 10. 

First, a color of a body to be extracted from picture data (each in the form of a color code, and a direction and a 
distance of the color from a representative color of a category) after conversion inputted from the data representation 
conversion section 35 will be designated (step A1). For example, when it is intended to extract only a body of a red 

35 automobile from the background of a forest (green of leaves or brown of trees), red is designated. This designation may 
be performed by way of a keyboard by an operator or by pointing the body of the automobile displayed on a screen using 
a mouse or a like apparatus. The body extraction section 37 detects a color code of the category of red in response to 
the designation of the color of the body to be extracted (step A2). 

Subsequently, the picture data are extracted successively, for example, in such a manner that they are extracted 

40 from a line in a horizontal direction beginning with the left upper corner and, after an end of the line is reached, they are 
extracted from a next line in the horizontal direction beginning with the left end of the next line, and then it is discriminated 
whether or not each of the color codes of the thus extracted data is the same as the color code of red (step A3). If the 
color code of the data is the same as the color code of red, then the picture element is extracted (from the YES route 
at step A3 to step A4), but if the color code of the data is not the same as the color code of red, then the picture element 

45 is not extracted (NO route at step A3), and a next picture element is investigated. The sequence of operations described 
above is performed for the entire picture, that is, for all of the picture elements (steps A3 to A5) to extract only the red 
body of the automobile. 

Accordingly, the body extraction section 37 described above has a function as color designation means for desig- 
nating a color of a body region to be specified in a picture, another function as comparison means for comparing the 
so colors of picture elements of color picture data with a color designated by the color designation means, and a further 
function as means for determi ning that a picture element constitutes the region to be specified if a result of the comparison 
by the comparison means proves that the color of the picture element of the color picture data is the same as the 
designated color. 

55 c4. Color Changing Processing 

Subsequently, processing performed by the color changing processing section 38 to change some or all colors of 
a picture constructed from color picture data after conversion will be described with reference to FIGS. 1 1 and 12. 
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The color changing processing section 38 changes a color by changing, for example, where picture data 28 inputted 
from the color changing processing section 38 represents color 1, direction 1 and distance 1 as seen in FIG. 1 1, the 
picture data 28 to picture data 29 which represents color 2, direction 1 and distance 1 . Consequently, calculation process- 
ing to vary a vector in a color space as is required for a reflection model is unnecessary. 

5 In the following, processing of changing the color of a particular region by the color changing processing section 38 

will be described in detail with reference to a flow chart of FIG. 12. 

First, with regard to picture data each represented by a color code based on the categorical perception and a direction 
and a distance from the color of the color code to a representative color of the category, the color of a body to be changed 
and an aimed color after change are designated (step B1). For example, when it is tried to change the color of a body 

io of a red automobile on the background of a forest (green of leaves or brown of trees) to blue, red and blue are designated. 
The designation may be performed by way of a keyboard by an operator or by pointing the body of the automobile 
displayed on a screen using a mouse or a like apparatus. In response to the designation, color codes of red and blue 
are determined (step B2). 

Subsequently, the picture data are successively extracted, for example, in such a manner that they are extracted 
75 from a line in a horizontal direction beginning with the left upper corner and, after an end of the line is reached, they are 
extracted from a next line in the horizontal direction beginning with the left end of the next line, and then it is discriminated 
whether or not each of the color codes of the thus extracted data is the same as the color code of red (step B3). If the 
color code of the data is the same as the color code of red, then the color code of the picture element is changed to the 
other color (blue) designated separately in such a manner as described above with reference to FIG. 1 1 (from the YES 
20 route at step B3 to step B4). 

However, when the color code is not the same as the color code of red, the color changing processing for the picture 
element is not performed for the data (NO route at step B3) , and similar processing is performed for a next picture element. 

The sequence of operations described above is performed for the entire picture, that is, for all of the picture elements 
(steps B3 to B5) so that only the color of the red body of the automobile can be changed. Consequently, color changing 
25 processing can be realized only based on discrimination regarding a code of a color represented by picture data (dis- 
crimination whether or not the color is the same as the designated color) without the necessity tor extraction of a body. 

It is to be noted that, also where it is instructed, in the color changing processing described above, to change the 
direction and the distance from a representative color of the category other than the color code, simi lar changi ng process- 
ing can be performed. 

30 Accordingly, the color changing processing section 38 functions as means for changing a color parameter having 
information of at least one of a code of a color classified based on the categorical perception and a deviation (in direction 
and distance) of color picture data from a representative color of a category to which the color picture data belongs. 

c5. Combination Processing of Conversion of Color Picture and Data compression 

35 

While the data representation conversion section 35 performs discrimination of color information based on the cat- 
egorical perception of human beings with regard to color picture data and conversion of the color picture data having 
the thus discriminated color information as described above in sections d and c2, the data compression section 40 can 
further compress the color picture data after such conversion. 

40 in particular, conversion of color picture data by the data representation conversion section 35 and compression 
processing for decreasing the amount of data such as, for example, a JPEG by the data compression section 40 can 
be combined with each other as seen from a flow chart shown in FIG. 13. 

Referring to FIG. 13, picture data are converted with color information based on the categorical perception using 
such a method as described hereinabove in section c1 or c2 by the data representation conversion section 35 (step C1), 

45 and then the amount of data which has been reduced by such conversion is further reduced by performing compression 
processing such as a JPEG by the data compression section 40 (step C2). 

c6. Conversion Processing of Color Picture Data Represented by Data Representation Conversion Section into RGB 
Data 

50 

In the following, processing of converting data represented in a color code based on the categorical perception 
and/or a direction and a distance from a representative color of a category by the data representation conversion section 

35 into RGB data or the like to be displayed on a display unit or a like apparatus by the display data conversion section 

36 will be described with reference to FIGS. 14(a) and 14(b). 

55 In particular, the display data conversion section 36 includes a table 36A which describes a corresponding relation- 
ship between color codes based on the categorical perception and RGB data of representative colors of categories as 
seen in FIG. 14(a) and includes another table 36B which describes, for each category, a corresponding relationship 
between deviations (direction and distance) from a representative color of the category and RGB data as seen in FIG. 
14(b). 
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Thus, the display data conversion section 36 can detect, when picture data are inputted from the data representation 
conversion section 35, RGB data to be displayed on a display unit making use of the tables 36A and 36B described 
above so that the picture data can be displayed as a picture on the color display unit 34. 

It is to be noted that, in the tables 36A and 36B, the representative color of each category may be a color at the 
s center of the category region shown in any of FIGS. 5(a) to 7(b) or a color prescribed in J IS. 

Meanwhile, if only such a table 36A for colors as seen in FIG. 1 4(a) is selectively used from between the two tables 
36A and 36B to display a picture, then a picture which conforms to the sensations of human beings to colors can be 
represented with a small amount of data for approximately twelve colors (4 bits). Further, if such a table 36B for deviations 
between colors and representative colors as shown in FIG. 14(b) is selectively used to display a picture, RGB data 
w approximately equivalent to an original picture can be obtained, and consequently, a display of a high picture quality can 
be obtained. 

Accordingly, the tables 36A and 36B function as means for indicating a corresponding relationship between color 
information based on the categorical perception and picture displayable data which can be inputted to the color display 
unit 34. Consequently, the display data conversion section 36 can convert picture data after conversion into picture 
is displayable data using the tables 36A and 36B. 

In this manner, with the color picture processing apparatus according to the first embodiment of the present invention, 
since a classification of colors based on the categorical perception of human beings is utilized for representation of 
picture data, the color picture processing apparatus is advantageous in that the amount of picture data can be reduced 
without degrading the picture quality while conforming to the sensations of human beings, and extraction of a body, a 
20 change of a color, reduction of the number of colors and so forth can be performed readily. The color picture processing 
apparatus is advantageous also in that the amount of data can be further reduced without degrading the picture quality 
by making use of a data compression technique such as a JPEG. 

Further, since a color as picture data can be represented in four bits in the minimum by the data representation 
conversion section 35, colors conforming to the sensations of human beings can be represented with an amount of data 
25 reduced to 1/6 to the utmost comparing with that of the RGB representation in which picture data are represented in 24 
bits in which individual 8 bits represent different colors. Consequently, handling of a picture with a higher efficiency can 
be realized. 

Furthermore, since data can be converted by referring to a lookup table in which the relationships among picture 
data and colors based on the categorical perception, representative colors of the individual categories, and deviations 

30 (direction, distance and so forth) from the representative colors are stored, the conversion processing can be performed 
at a higher speed than that by conversion which is based on software or the like, and consequently, a remarkable increase 
in processing speed can be anticipated. 

Meanwhile, when color picture data of an original picture element belongs to a boundary of a category of a color, 
the data representation conversion section 35 investigates categories of picture elements around the original picture 

35 element and determines a color which appears most frequently at the picture elements around the original picture ele- 
ments as the color of the object of investigation. Consequently, a color in a boundary region which cannot be classified 
readily when picture data are represented using colors based on the categorical perception can be determined with 
certainty. As a result, there is an advantage in that picture data of a high picture quality in accordance with which no 
such situation that a different color such as a color of noise appears in one body occurs can be obtained. 

40 Further, since region extraction processing of a body by the body extraction section 37 can be performed only by 
determination regarding a code of a color of picture data (whether or not the color is the same as a designated color), 
processing conforming to the sensations of human beings can be performed at a higher speed than that by another 
method which is based on manual operation or makes use of the hue. 

Furthermore, since color changing processing by the color changing processing section 38 can be realized only 

45 based on determination regarding a code of a color of picture data (whether or not the color is the same as the designated 
color) without the necessity of extraction of the color of a body, the color picture processing apparatus is advantageous 
also in that calculation processing for changing a vector in a color space is unnecessary and the processing time for 
changing a color is reduced as much, and high speed processing conforming to the sensations of human beings can 
be performed. 

so Further, since data compression processing of color picture data after conversion into color information based on 

the categorical perception is performed by the data compression section 40, the amount of data can be further reduced. 
Such compressed data provides an advantage in that the capacity of a hard disk or a like storage medium required to 
store data can be reduced, and in transmission which makes use of a channel, the communication time can be reduced. 
Further, rf the table 36A is selected to display a picture, a picture which conforms to the sensations of human beings 

55 to colors can be represented with small data for approximately 12 colors (4 bits), and as a result, there is an advantage 
in that, comparing with a display of, for example, 256 colors, the amount of data can be reduced to one half, and the 
memory for display data can be reduced very much. 

Furthermore, if the table 36B for deviations between colors and representative colors is selectively used to display 
a picture, RGB data approximately equivalent to an original picture can be obtained, and a picture of a high picture 
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quality can be displayed. Further, where such conversion is performed making use of a lookup table for which an IC 
memory is used, high speed processing for reduction in number of colors can be performed. 

It is to be noted that, while the data representation conversion section 35 in the embodiment described above rep- 
resents picture data in a color code and/or deviation information of a direction and deviation information of a distance 
s of object picture data from a representative color of the category, the representation of picture data is not limited to that 
described above, and picture data may alternatively be represented, for example, in a color code and a parameter which 
represents at least one of the brightness and the clearness. Also in this instance, using parameters of the brightness 
and the clearness in place of deviations of the direction and the distance illustrated in FIG. 8(b), picture data can be 
represented in totaling 12 bits. 

io By the way, as described in detail in section A. Colors Based on Categorical Perception of Human Beings, the 
clearness does not have much relation to perception of human beings to colors. Accordingly, the data representation 
conversion section 35 may represent a color, which may be represented, for example, by a small symbol in FIGS. 5(a) 
to 7(b) but exhibits a little lower degree of coincidence among testees, as a different color which is different only in 
clearness. 

75 With the representation just described, picture data which further conform to the perception of human beings and 
whose amount is further reduced can be represented. Further, since the data form does not include a component of the 
brightness, the compression efficiency of the JPEG or the like is high, and data can be reduced remarkably in amount 
while maintaining the picture quality. 

Furthermore, while the colors of nine picture elements including an object picture element and eight picture elements 

20 around the object picture element are investigated upon determination of a category from picture data in a boundary 
region by the data representation conversion section 35 in the embodiment described above, the picture elements for 
investigation are not limited to those nine picture elements, and where a picture involves a comparatively small number 
of colors, by performing an investigation for totaling four picture elements or so at the upper and lower positions and the 
left and right locations to the location of an object picture element, a similar degree of accuracy can be achieved while 

25 the processing time is decreased. 

Further, by constructing a picture processing system by combining two or more of such processes including con- 
version of input picture data by the data representation conversion section 35, various picture processes (a body extract- 
ing process by the body extraction section 37, a color changing process by the color changing processing section 38 
and a data compression process by the data compression section 40) and a displaying process for reduction in number 

30 of colors as described above, the system can be realized in accordance with an application of it. Consequently, in the 
inside of the system realized in this manner, picture data can all be represented in deviations between codes of colors 
classified in category and representative colors of the categories, and accordingly, various processes can be performed 
at a high speed and in a high picture quality. 

35 D. Second Embodiment 

Subsequently, a second preferred embodiment of the present invention will be described with reference to the draw- 
ings. 

40 d0. General Construction of Color Picture Processing Apparatus 

Referring now to FIG. 15, there is shown in block diagram a color picture processing apparatus according to the 
second preferred embodiment of the present invention. The color picture processing apparatus shown includes a picture 
inputting apparatus 31 , an input picture storage memory 32, a display memory 33 and a color display unit 34 which have 
45 similar functions to those of the color picture processing apparatus of the first embodiment described above. Accordingly, 
overlapping description of them will be omitted herein to avoid redundancy. 

The color picture processing apparatus further includes extraction designation means 45A manually operable by 
an operator to designate a body whose color is to be changed. The extraction designation means 45A may be constituted 
from, for example, a mouse or a keyboard. The color picture processing apparatus further includes a picture data extrac- 
50 tion section 46 for extracting a region of a body designated by the extraction designation means 45A. 

Accordingly, the extraction designation means 45A and the picture data extraction section 46 function as body region 
extraction means for designating and extracting a color of an arbitrary body region in a picture constructed from inputted 
color picture data. 

The color picture processing apparatus further includes a parameter derivation section (body color detection means) 
55 47 for deriving a calculation parameter such as a color of a body or data (picture data) of each picture element extracted 
by the picture data extraction section 46. 

The color picture processing apparatus further includes aimed color designation means 45B for setting an aimed 
color for a color change for an extracted body color in response to an operation of an operator. The aimed color desig- 
nation means 45B may be constituted from, for example, a mouse or a keyboard. 
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The color picture processing apparatus further includes a color changing processing section (color changing means) 
50 for changing the color of a body extracted by the picture data extraction section 46 in accordance with an aimed color 
for a color change designated by way of the aimed color designation means 45B by an operator. A result of the color 
change of the color changing processing section 50 is displayed on the color display unit 34. 

5 The color picture processing apparatus further includes a color category derivation section (first category discrim- 

ination means, second category discrimination means and category difference discrimination means) 48 for discrimi-\ 
nating, based on a calculation parameter derived by the parameter derivation section 47, to a color of which category 
the color of an extracted body or data of each picture element belongs. 

In particular, the color category derivation section 48 discriminates to color information of which one of a plurality 

10 of categories of color information classified based on the categorical perception of human beings a color designated for 
extraction, a derived body color or a designated aimed color described above belongs, and discriminates to color infor- 
mation of which one of the plurality of categories of color information classified based on the categorical perception of 
human beings color picture data in the body region before or after a color change belongs. 

Further, the color category derivation section 48 performs discrimination of whether or not a designated color for 

75 extraction, a body color and an aimed color discriminated based on the categorical perception belong to a same category 
to color picture data discriminated based on the category perception. 

The color picture processing apparatus further includes picture data conversion section (picture data changing 
means) 49 for removing such picture data as noise from among color picture data before or after a color change based 
on a result of category different discrimination information from the color category derivation section 48. 

20 In other words, the picture data conversion section 49 removes noise picture data or the like from color picture data 
before or after color changing processing by the color changing processing section 50 based on a result of category 
difference discrimination from the color category derivation section 48, and picture data obtained as a result of such 
removal are displayed on the color display unit 34. 

Processing operation of the color picture processing apparatus according to the second embodiment of the present 

25 invention having the construction described above will be described below with reference to a flow chart of FIG. 16. 

In particular, in response to an operation by an operator, the picture data extraction section 46 receives an instruction 
from the extraction designation means 45A and extracts a color change object body (region) from a picture (step D1). 
The instruction from the extraction designation means 45A may be performed, for example, by the operator inputting an 
instruction on a display screen making use of a mouse or the like (step D2) or by the operator inputting an instruction 

30 of a color, and a body region is extracted based on the thus instructed color using a method which will be hereinafter 
described. 

Then, the parameter derivation section 47 detects the color of the extracted body as a parameter (step D2). Such 
detection is based on a method wherein the color is detected, for example, from a distribution of data on such a chro- 
maticity diagram shown in one of FIGS. 5(a) to 7(b). 
35 Then, the operator will designate an aimed color for a color change by operation of the aimed color designation 
means 45B by the operator (step D2). In this instance, color patches (colored squares) may be displayed on the color 
display unit 34 so as to be designated by way of a mouse or a like element or RGB values may be inputted directly by 
way of a keyboard. 

Thereafter, the category of the color (designated color) designated by the operator, the parameter (body color) of 
40 the color of the extracted body designated by the color category derivation section 48 or the aimed color designated by 
the aimed color designation means 45B at step D 1 or D2 is detected (step D3). In particular, coordinates of the designated 
color, the body color and the aimed color in the XYZ color space are detected and are compared with the chromaticity 
diagrams shown in FIGS. 5(a) to 7(b) to discriminate a relevant category. In this instance, the category is discriminated, 
for example, using such a lookup table for conversion from xy chromaticity values and a brightness into RGB datk values 
45 as shown in any of FIGS. 5(a) to 7(b). ( 

Then, the color category derivation section 48 detects a category of a color for each picture element from picture 
data of the body region before or after color conversion by the color changing processing section 50, that is, from picture 
data in the body region extracted by the picture data extraction section 46 (step D4). Also in this instance, the category 
of a color is detected, for example, using such a lookup table for conversion from xy chromaticity values and a brightness 
so into RGB data values as shown in any of FIGS. 5(a) to 7(b). 

Thereafter, the color category derivation section 48 compares the category of the designated color, the body color 
or the aimed color obtained at step D3 or D4 with the category of data of each picture element to discriminate whether 
the categories of the colors are same as or different from each other (step D5). 

Then, a result of the discrimination by the color category derivation section 48. a message requesting the operator 
55 for instruction for data conversion or the like and so forth are displayed (step D6). 

Particularly, a region desired by the operator can be extracted simply, for example, by extracting a color in a body 
region which belongs to the same category as that of the designated color. The region thus extracted can be utilized for 
a color change or for composition of pictures. Or conversely, picture data which have a different category in color may 
be displayed while the operator is inquired to determine whether data at the portion should be changed in color or be 
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left as it is (should be deleted from the object of a color change). This allows a color change with a high degree of 
accuracy (conforming to the will of the operator). 

The data conversion processing performed based on an instruction by the operator at step D6 described above may 
have following forms depending upon whether it is performed before or after a color changing operation. 

5 

d1. First Picture Data Changing Process before Color Change 

FIG. 1 7 is a flow chart illustrating a first picture data conversion process before a color change which is based on 
a result of discrimination of whether or not a category of a body color and a category of color picture data of a body 
10 region before a color change are same as or different from each other. 

Here, operations beginning with the extraction processing of a body for a color change and ending with the discrim- 
ination processing of difference in category between a body color and picture data at steps El to E5 correspond to the 
operations at steps D1 to D5 of the flow chart of FIG. 16 described hereinabove. 

In particular, referring to FIG. 17, in response to an operation of an operator, the picture data extraction section 46 
15 receives an instruction from the extraction designation means 45A and extracts a color change object body (region) from 
a picture (step E1). Then, the parameter derivation section 47 derives the color of the extracted body as a parameter 
(step E2). 

Then, a category of the thus derived body color is detected (step E3). In particular, the category is detected by 
detecting coordinates of the body color in the XY2 color space and using such a lookup table for conversion from xy 
20 chrominance values and a brightness into RGB data values as shown in any one of FIGS. 5(a) to 7(b). 

Thereafter, using a similar method to that used at step E3 described above, a category of a color is identified for 
each one of picture elements from the picture data of the color change object body (step E4). Then, the category of the 
color thus detected from the picture data is compared with the category of the body color identified at step E3 (step E5). 
Here, where the categories are different from each other, the picture data conversion section 49 changes the color 
25 of the picture data of the picture element to the color of the same category as that of the body color (NO route at step 
E5 to step E6), but where the categories are same as each other (YES route at step E5), similar processing is subse- 
quently performed for a next picture element (NO route at step E7 to step E8). 

More particularly, the picture data of the color change object body are distributed, for example, in such a manner 
as seen in FIG. 18(a) in the color space. In the picture data illustrated in FIG. 18(a), almost all picture data belong to 
30 the category of the body color, but the color of any picture data which does not belong to the category of the body color 
is changed to the color of the same category as that of the body color. 

In particular, the picture data conversion section 49 changes picture data which do not belong to the category of 
the body color to data on the boundary of the category of the body color as seen from FIGS. 18(b) and 18(c). More 
particularly, the position of the body color in the color space (for example, the representative color) and the position of 
35 the picture element of the object of a color change are interconnected by way of a straight line, and the picture element 
of the object of the color change is changed to a crossing point between the straight line and the category boundary. 

The operations at steps E4 to E6 described above are performed for all of the picture data of the color change object 
body (step E7). Thereafter, a color changing calculation based on a reflection model is performed for results of the 
processing described above. Consequently, color changing processing is performed in such a form that the changing 
40 amounts of data outside the range of the category of the body color are minimized as seen in FIG. 18(c) and data of 
irregular colors arising from noise in the body are removed. 

d2. Second Picture Data Changing Process before Color Change 

45 FIG. 1 9 is a flow chart illustrating a second picture data changing process before a color change which is based on 

a result of discrimination of difference between a category of a body color and a category of color picture data of a body 
region before a color change. 

In the second picture data changing process illustrated in FIG. 19, when the categories of colors of picture data of 
an object of a color change are all same as the category of a body color, similar processing to the processing described 
so hereinabove with reference to FIG. 17 is performed. 

In particular, similarly as in the processing described above with reference to FIG. 1 7, the operations beginning with 
the extraction operation of a body by the picture data extraction section 46 (step E1) and ending with the comparison 
operation between the category of a color of picture data and the category of a body color by the color category derivation 
section 48 (step E5) are performed, and if the picture data of all picture elements have a same category in color as that 
55 of the body color, then conversion of the picture data is not performed (steps E4, E5. E7 and E8). 

On the other hand, when some of the picture data have a different category or categories in color from that of the 
body color (NO route at step E5), the picture data conversion section 49 changes not only the category of the colors of 
those picture data but the category of the colors of all picture data (step F6). 
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In particular, while the picture data of the color change object body are distributed, for example, in such a manner 
as seen in FIG. 20(a) in the color space, when some picture data whose colors do not belong to the category of the 
body color are included in the picture data as seen in FIG. 20(a). the picture data are moved so that the colors of all of 
them may be included in the category of the body color as seen in FIG. 20(c). 
5 In particular, a straight line (vector) in the color space which interconnects the position of the body color and the 

position of each data whose color does not belong to the category of the body color is determined first, and then a 
crossing point between the straight line (vector) and a boundary portion of the color category of the body color is deter- 
mined. 

Further, a ratio between the distance between the body color and the color of the picture data (length of a vector 
w from the position of the body color to the position of the picture data in the color space, that is, distance 2) and the 
distance between the body color and the crossing point on the category boundary (length of a vector from the position 
of the body color to the crossing point, that is, distance 1), that is, distance 1 /distance 2, is calculated. Then, such ratio 
is calculated for all picture data outside the category of the body color, and a minimum value among values of the ratio 
calculated in this manner is stored. 
75 Then, the positions of all of the picture data including the picture data included in the category of the body color are 
changed in accordance with the thus stored minimum value of the ratio, that is, the distances from the position of the 
body color to the positions of all of the picture data are reduced (the lengths of vectors are reduced) in accordance with 
the stored minimum value of the ratio. For example, when the ratio is 2:1 , the positions of all of the picture data are 
moved so that the distances of them from the position of the body color may be reduced to 1/2 
20 Consequently, any picture data which exhibits a maximum value in terms of the distance to the crossing point can 

be moved to the crossing point. Accordingly, the positions of all of the picture data can be changed to positions in the 
category of the body color (the lengths of the vectors between the body color and the individual picture data are reduced) 
eliminating presence of data outside the category. 

25 63. First Picture Data Changing Process after Color Change 

While the processing of picture data before a color change is described in sections d1 and d2 above, processing of 
picture data of a body (region) after a color change will be described below. 

FIG. 21 is a flow chart illustrating a first picture data changing process after a color change which is based on a 
30 result of discrimination of difference between a category of an aimed color and a category of color picture data after a 
color change. 

Referring to FIG. 21 , an operator will first operate the aimed color designation means 45B to designate an aimed 
color for a color change (step G1). In response to the operation, the color changing processing section 50 performs a 
color changing operation to the thus designated aimed color (step G2). 
35 Then, similar processing to that performed for the model described hereinabove with reference to FIG. 17 is per- 
formed for the picture data of the body (region) for which the color changing operation by the color changing processing 
section 50 has been completed. 

In particular, a category of a color to be aimed for a color change (aimed color) is detected similarly as at step E3 
in FIG. 17 described above (step G3). In this instance, the category is detected by calculating coordinates of the aimed 
40 color in the XYZ color space and using such a lookup table for conversion from xy chrominance values and a brightness 
into RGB data values or the like as illustrated in any one of FIGS. 5(a) to 7(b). 

Further, similarly as at steps E4 to E8 in FIG. 17, a category of a color is detected for each one of picture elements 
from the picture data of the body after the color change (step G4), and the category of the picture data thus detected is 
compared with the category of the aimed color (step G5). If the categories are the same as each other (YES route at 
45 step G5), then similar processing is subsequently performed for a next picture element (NO route at step G7 to step 
G8). On the other hand, when the categories are different from each other (NO route at step G5), the color of the picture 
data is changed to the color of the same category as that of the aimed color (step G6). 

More particularly, while almost all of the colors of the picture data after the color change belong to the category of 
the aimed color in the color space as seen in FIG. 22(a), data conversion by the picture data conversion section 49 is 
so performed for any picture data whose color does not belong to the category of the aimed color. 

In particular, the picture data conversion section 49 changes any picture data whose color does not belong to the 
category of the aimed color to a position on the boundary of the category of the aimed color as seen from FIGS. 22(b) 
and 22(c). More particularly, the position of the aimed color and the position of a picture element of an object of a color 
change in the color space are interconnected by a straight line, and the position of the picture data is changed to a 
55 crossing point between the straight line and the boundary of the category. 

Such operations at steps G4 to G6 as described above are performed for all of the picture data of the color change 
object body (step G7). Thereafter, a color changing calculation based on a reflection model is performed for results of 
the processing described above. Consequently, presence of data of irregular colors arising from noise in the body after 
the color change is eliminated. 
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64. Second Picture Data Changing Process after Color Change 

FIG. 23 is a flow chart illustrating a second picture data changing process after a color change which is based on 
a result of discrimination in difference between a category of an aimed color and a category of color picture data of a 
s body (region) after a color change. 

In the second color picture changing process illustrated in FIG. 23, when all of the categories of the colors of picture \ 
data after color conversion are the same as the category of an aimed picture, similar processing to that described 
hereinabove with reference to FIG. 21 is performed. 

In particular, similarly as in the processing described hereinabove with reference to FIG. 21 , the operations beginning 
w with the extraction operation of a body by the picture data extraction section 46 (step G1 ) and ending with the comparison 
processing between the category of the color of picture data and the category of the aimed color from the color category 
derivation section 48 (step G5) are performed. Then, when all of the categories of the colors of picture elements are the 
same as the category of the aimed color, a change of the picture data is not performed (steps G4, G5, G7 and G8). 
On the other hand, when the category of the color of any of the picture data is different from the category of the 
15 aimed color (NO route at step G5), similar processing to that for the model described hereinabove with reference to FIG. 
19 is performed. 

In particular, the picture data conversion section 49 changes not only the category of the color of the picture data 
but the categories of the colors of all of the picture data (step H6). 

More particularly while the picture data after a color change are distributed in such a manner as seen, for example, 
20 in FIG. 20(a) in the color space, where the colors of some of the picture elements do not belong to the category of the 
aimed color as seen in FIG. 24(a), the positions of them are moved so that the colors of all of the picture data may be 
included in the category of the aimed color as seen in FIG. 24(c). 

In particular, a straight line (vector) in the color space which interconnects the position of the aimed color and the 
position of each data whose color does not belong to the category of the aimed color is determined first, and then a 
25 crossing point between the straight line (vector) and a boundary portion of the category of the aimed color is determined. 
Further, as seen in FIG. 24(b), a ratio between the distance between the aimed color and the picture data (length 
of a vector from the position of the aimed color to the position of the picture data in the color space, that is, distance 2) 
and the distance between the aimed color and the crossing point on the category boundary (length of a vector from the 
position of the aimed color to the crossing point, that is, distance 1), that is, distance 1/distance 2, is calculated. Then, 
30 such ratio is calculated for all picture data outside the category of the aimed color, and a minimum value among values 
of the ratio calculated in this manner is stored. 

Then, the positions of all of the picture data including those picture data included in the category of the aimed color 
are changed in accordance with the thus stored minimum value of the ratio, that is, the distances from the position of 
the aimed color to the positions of all of the picture data are reduced (the lengths of the vectors are reduced) in accordance 
35 with the stored minimum value of the ratio. For example, when the ratio mentioned above is 2:1, the picture data are 
individually moved so that the distances of them from the position of the aimed color may be reduced to 1/2. 

Consequently, any picture data which exhibits a maximum value in terms of the distance to the crossing point can 
be moved to the crossing point. Accordingly, the positions of all of the picture data can be changed to positions in the 
category of the body color (the lengths of the vectors between the aimed color and the individual picture data are reduced) 
40 eliminating presence of data outside the category. 

In this manner, with the color picture processing apparatus according to the second embodiment of the present 
invention, since the picture data conversion section 49 can change color picture data before or after a color change 
based on a result of discrimination in category by the color category derivation section 48, there is an advantage in that 
the picture quality can be improved by reducing noise in data of a body picture of an object of the color change or by 
45 reducing noise expanded by the color change. j 
Further, since color picture data before a color change can be changed by the picture data conversion section '49 
in the description of d1 . First Picture Data Changing Process before Color Change above, data of irregular colors arising 
from noise in the body can be reduced with a minimum amount of a change of the data, and as a result, such a noise 
as will degrade the picture quality after the color change does not appear and a color change of a high quality can be 
so realized. 

Furthermore, since any data outside a category can be eliminated without any variation of the relative positional 
relationship of the entire picture data by the changing processing of color picture data before a color change by the 
picture data conversion section 49 in the description of d2. Second Picture Data Changing Process before Color Change, 
resulted data do not include such data as may possibly have a bad influence on the picture quality as a result of the 
55 color change, and consequently, the influence of the change of data upon the picture quality can be reduced remarkably. 

Further, since color picture data after a color change by the picture data conversion section 49 in the description of 
d3. First Picture Data Changing Process after Color Change can be changed, data of irregular colors arising from noise 
in the body after the color change can be removed with a minimum amount of a change of the data, and as a result, the 
picture quality after the color change can be improved. 
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Furthermore, since any data outside a category can be eliminated without any variation of the relative positional 
relationship of the entire picture data by the changing processing of color picture data after a color change by the picture 
data conversion section 49 in the description of d4. Second Picture Data Changing Process after Color Change, resulted 
data do not include such data as may possibly have a bad influence on the picture quality as a result of the color change, 
5 and consequently, the influence of the change of data upon the picture quality can be reduced remarkably. 

It is to be noted that, according to the present invention, the color picture processing apparatus may be constructed 
so as to have two or more of the processes described above (data changing processes before and after the color change) 
in combination. 

In this instance, even when noise is produced, after a color change, by an error occurring in color changing calculation 
10 after data conversion is performed by the picture data conversion section 49 to remove noise before the color change, 
such noise can be eliminated by performing data conversion by the picture data conversion section 49. As a result, a 
picture of a changed color of a high picture quality free from an influence of an error in calculation can be obtained. 

E. Third Embodiment 

15 

Subsequently, a third preferred embodiment of the present invention will be described with reference to the drawings. 

FIG. 25 shows in block diagram a color picture processing apparatus according to a third preferred embodiment of 
the present invention. Referring to FIG. 25, the color picture processing apparatus shown changes the color of an arbitrary 
body region in a color picture by changing the position of data indicating the body region in a color space and includes 
20 a picture inputting apparatus 31 , an input picture storage memory 32, a display memory 33 and a color display unit 34 
which have individually similar functions to those of the color picture processing apparatus of the first and second embod- 
iments described above. 

The color picture processing apparatus further includes a parameter derivation section (body color detection means) 
55 for detecting a body color of body data as a calculation parameter such as a color of a body similarly to the parameter 
25 derivation section 47 in the second embodiment described above. 

The color picture processing apparatus further includes aimed color designation means 59 for designating an aimed 
color for a color change of body data by operation of an operator. 

The color picture processing apparatus further includes a color category derivation section 56 for discriminating to 
color information of which one of a plurality of categories of color information classified based on the categorical per- 
30 ception of human beings body color data indicating a body region before and after a color change, respectively, and 
aimed color data belong. In particular, the color category derivation section 56 discriminates to categories of which 
colors body colors derived by the parameter derivation section 55 and an aimed color for the color change designated 
by the aimed color designation means 59 belong. 

The color picture processing apparatus further includes a category comparison section (category difference dis- 
35 crimination means) 57 for discriminating whether or not data obtained by conversion by a color changing section 58, 
which will be described below, and indicating a body region before and after a color change belong to a same category. 

In other words, the category comparison section 57 discriminates a category of a derived color (body color data 
indicating a body region before a color change) derived from the body region and also discriminates a category of an 
aimed color (bode color data indicating the body region after the color change) described as a color to be aimed for the 
AO color change, and compares the category of the derived color and the category of the aimed color with each other. 

The color changing section (data conversion means, color changing means) 58 mentioned above converts data so 
that they may have color information derived by the color category derivation section 56, and changes, based on a result 
of the discrimination by the category comparison section 57, the positions of data in the color space to change the color 
of the body. 

45 It is to be noted that also picture data changed in color by the color changing section 58 are displayed on the color 

display unit 34. 

Where the color space is constructed as a space which can be represented in brightness, saturation and hue as 
seen in FIGS. 28(a) and 28(b), the color changing section 58 can change at least one of values of the brightness, 
saturation and hue. 

so Further, the color changing section 58 can perform data decompression processing or data compression processing 

of data in the color space in the direction of the saturation as seen in FIGS. 31(a) and 31(b) to vary the value of the 
saturation. Furthermore, the color changing section 58 can perform data decompression processing or data compression 
processing of data in the color space in the direction of the brightness to vary the value of the brightness. In addition, 
the color changing section 58 can perform data rotating processing around a straight line representing achromatic colors 

55 to vary the value of the hue as seen in FIGS. 30(a) and 30(b). 

The color picture data processing apparatus according to the third embodiment of the present invention having the 
construction described above operates in such a manner as illustrated in af low chart of FIG. 26 to perform color changing 
processing. 
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In particular, referring to FIG. 26, picture data representing a body region will be inputted from the picture inputting 
apparatus 31 (step J1). The picture data are stored once into the input picture storage memory 32. Then, the parameter 
derivation section 55 detects a body color based on the inputted picture data (step J2). Thereafter, a color to be aimed 
for a color change (aimed color) will be inputted by an instruction of the operator or the like (step J2). 

s Then, the color category derivation section 56 detects a category in color of the aimed color thus instructed or of 

the derived body color. It is to be noted that, also in the derivation processing for a category by the color category 
derivation section 56, coordinates of the body color and the aimed color in the XYZ color space are detected and com- 
pared with FIGS. 5(a) to 7(b) to derive categories of them similarly as in the first and second embodiments described 
above. In this instance, the categories are derived, for example, using such a lookup table for conversion of xy chromi- 

io nance values and a brightness into RGB data values as shown in any of in FIGS. 5(a) to 7(b). 

Then, the category comparison section 57 compares the categories of the body color and the aimed color derived 
by the color category derivation section 56 with each other to discriminate whether the categories in color are same as 
or different from each other. In other words, the category comparison section 57 compares the color (body color) of the 
body region before a color change and the color (aimed color) of the body region after the color change with each other 

15 (step J3). 

Thereafter, the color changing section 58 performs color changing processing based on a result of the comparison 
between the categories in color by the category comparison section 57 (step J4) . Dependi ng upon whether the categories 
of the body color and the aimed color are same or different, corresponding color changing processing is performed. 
Such color changing processing by the color changing section 58 based on a result of comparison in category in 
20 color as described above will be described with reference to a flow chart shown in FIG. 27. 

It is to be noted that, in the color changing processing by the color changing section 58, the color space includes 
the brightness (V), the saturation (S) and the hue (H), and in the color space, body data can be moved while maintaining 
one or more parameters of the brightness (V), the saturation (S) and the hue (H). 

Further, while inputted picture data are distributed three-dimensionally as seen in FIG. 28(a), for simplified descrip- 
25 tion, a plane which represents the hue and the saturation only at a certain brightness is used as seen in FIG. 28(b). 

In particular, the category comparison section 57 compares the categories of the body color and the aimed color 
derived by the color category derivation section 56 to discriminate whether the categories of the colors are same as or 
different from each other (step J3). When the categories are same, the body data are rotated around the white in the 
color space as seen in FIG. 29(b) (step K3). Consequently, the relative positional relationship of the body data (positional 
30 relationship of the symbols A, B, C and D) are maintained to that before such rotation, and accordingly, for example, a 
feeling of a reflection condition of an original picture can be left as it is. 

Upon such rotation of the body data, a plane 60A including a line indicating white (that is, the axis of the brightness) 
and the body color is imagined as seen in FIG. 30(a). The body data are rotated around an axis provided by the line 
indicating white while maintaining the relative positional relationship to the plane. Consequently, the plane 60A is rotated 
35 to make a plane 60B which includes the line indicating white and the aimed color as seen in FIG. 30(b) thereby performing 
color changing in which only the hue can be changed. 

After such rotation of the body data is performed at step K3 in FIG. 27, the distance between the position of the 
white and the position of the body color on the chromaticity diagram and the distance between the position of the white 
and the position of the aimed color are calculated, and the two distances are compared with each other (step K4). 
40 Then, decompression/compression processing of the plane in the direction of the saturation is performed in accord- 
ance with the ratio between the two distances while maintaining the relative positional relationship to the plane 60A as 
seen from FIGS. 31(a) and 31(b) (step K5). It is to be noted that FIG. 31(b) illustrates the decompression processing. 

Here, the ratio of the decompression/compression is determined from a ratio between the distance of the white and 
the body color in the direction of the saturation and the distance between the white and the aimed color in the direction 
45 of the saturation. In this instance, the distance between the position of the white and the position of the aimed color is 
greater than the distance between the position of the white and the position of the body color as seen in FIG. 31 (a), and 
accordingly, decompression processing is performed as seen from FIG. 31(b). 

Further, also when the body color and the aimed color are different in brightness, decompression or compression 
processing can be performed in the direction of the brightness using a similar method. Consequently, color changing 
so which takes the saturation and the brightness of the aimed color into consideration can be performed. 

Consequently, where the categories in color between the body color and the aimed color are same, particularly 
when the body color and the aimed color are different in saturation, the positional relationship of the data distribution is 
maintained, and an effect of unexpected reflection or a like effect can be maintained naturally. 

By the way, when it is discriminated, in discrimination of whether the categories in color are same or different at 
55 step J3 described above, that the category of the body color and the category of the aimed color are different from each 
other, such color changing processing as seen in FIG. 29(a) is performed. 

In particular, the body data are reversed symmetrically with respect to the plane 60A including the line indicating 
the white and the body color as seen from FIGS. 32(a) and 32(b) (step K2). In this instance, while the symbols A, B, C 
and D are distributed, before the reversal of the body data, in such a manner as seen in FIG. 32(a), they are distributed, 
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as a result of the reversal, in such a manner as seen in FIG. 32(b). Consequently, for example, a feeling of reflection on 
the picture after the reversal can be maintained natural. 

After the body data are reversed in such a manner as described above (step K2), similar processing to that which 
is performed when the categories are same described above is performed. In particular, also when the categories are 
5 different, rotation processing of the reversed body data around the white (step K3) and decompression/compression 
processing of the body data in accordance with the ratio in distance (step K4 or K5) are performed. 

In this manner, with the color picture processing apparatus according to the third embodiment of the present inven- 
tion, since the positions of data in the color space can be changed by the color changing section 58 based on a result 
of discrimination in category by the category comparison section 57, even when the color of the body which is influenced 
10 by unexpected reflection or the like is to be changed, the effect of the reflection can be maintained. Consequently, there 
is an advantage in that a natural result conforming to the sensations of human beings can be obtained. 

It is to be noted that similar effects to those of the color picture processing apparatus of the present embodiment 
can be obtained even by rotating, as processing to be performed when the categories of the body color and the aimed 
color are different, the data distribution first (step K3), performing decompression/compression (step K4 or K5) and then 
75 reversing the body data symmetrically with respect to the plane including the line indicating white (= brightness axis) 
and the aimed color (step K2). 

Further, the color picture processing apparatus according to the present embodiment may additionally have a func- 
tion of selecting whether or not a data distribution should be reversed in response to an instruction by a user. Where the 
color picture processing apparatus has the additional function, while a color changing method can be automatically 
20 discriminated by comparison in category to obtain a result, when the result is not desirable for the user, since the color 
changing method can be discriminated, a result of a color change of a more natural feeling can be obtained. 

The present invention is not limited to the specifically described embodiment, and variations and modifications may 
be made without departing from the scope of the present invention, 

25 Claims 

1 . A color picture processing method, characterized in that it comprises the steps of: 

discriminating to color information of which one of a plurality of categories of color information based on a 
plurality of classified colors inputted color picture data belong; 
30 converting the color picture data so as to have the thus discriminated color information; and 

performing succeeding picture processing using the color picture data after the conversion. 

2- A color picture processing method as set forth in claim 1 , characterized in that the color information based on the 
plurality of classified colors is information of a plurality of categories classified based on categorical perception of 
35 human beings. 

3. A color picture processing method, comprising the steps of: 

representing a color of picture data as a color code representing one of a plurality of classified colors and a 
deviation between the color of the picture data and a representative color of a color category to which a color 
40 represented by data including the color code information belongs; and 

performing succeeding picture processing using the thus represented color. 

4. A color picture processing method as set forth in claim 3, characterized in that the plurality of classified colors are 
colors classified based on categorical perception of human beings. 

45 

5. A color picture processing method as set forth in claim 3, characterized in that the deviation is data representative 
of a direction of the color of the picture data from the representative color of the color category 

6. A color picture processing method as set forth in claim 3, characterized in that the deviation is data representative 
so of a distance of the color of the picture data from the representative color of the color category. 

7. A color picture processing apparatus, comprising: 

color picture data inputting means (1) for inputting color picture data; 

category discrimination means (2) for discriminating to color information of which one of a plurality of cate- 
55 gories of color information classified based on categorical perception of human beings the color picture data inputted 
from said color picture data inputting means (1) belong; 

picture data conversion means (3) for converting the color picture data so as to have the color information 
discriminated by said category discrimination means (2); and 
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picture processing means for performing picture processing using the color picture data converted into the 
color information based on the categorical perception by said picture data conversion means (3). 

A color picture processing apparatus as set forth in claim 7, characterized in that said picture data conversion means 
(3) includes means for converting the color picture data using a code of a color classified based on the categorical 
perception of human beings. 

A color picture processing apparatus as set forth in claim 7, characterized in that said picture data conversion means 
(3) includes means for converting the color picture data using combination information of a code of a color classified 
based on the categorical perception and a deviation between the color picture data and a representative color of a 
category to which the color picture data belong. 



1 0. A color picture processing apparatus as set forth in claim 7, characterized in that said picture data conversion means 
(3) includes means for converting the color picture data using combination information of a code of a color classified 

15 based on the categorical perception and a parameter representing at least one of the brightness and the clearness. 

1 1 . A color picture processing apparatus as set forth in claim 7, characterized in that said category discrimination means 
(2) discriminates, when color picture data of an object picture element belongs to a boundary region of a category 
of a color, to color information of which one of the categories the color picture data belong, based on a relationship 

20 to category colors of picture elements around the object picture element of the color picture data. 

12. A color picture processing apparatus as set forth in claim 11, characterized in that said category discrimination 
means (2) detects, when the color picture data of the object picture element belongs to the boundary region of the 
category of the color, categories in color of the picture elements around the object picture element of the color 

25 picture data, counts the numbers of picture elements of same categories and discriminates that one of the categories 
whose number of picture elements is the greatest among the counted numbers as the category of the color picture 
data. 

13. A color picture processing method, comprising the steps of: 

30 discriminating to color information of which one of a plurality of categories of color information classified 

based on categorical perception of human beings inputted color picture data belong; 

converting the color picture data so as to have the thus discriminated color information; and 
performing region extraction processing of specifying and extracting, from the color picture information after 
conversion into the color picture information based on the categorical perception, a partial region of a picture con- 
35 structed from the color picture data after the conversion. 

14. A color picture processing method as set forth in claim 1 3, characterized in that, in the region extraction processing, 
after a color to be specified in the picture is designated, the thus designated color and colors of picture elements 
of the color picture data are compared with each other, and when a result of the comparison proves that the desig- 

40 nated color and the colors of the picture elements of the color picture data are the same color, the picture elements 
are determined to be picture elements which construct the region to be specified. 

15. A color picture processing apparatus, comprising: 

color picture data inputting means (1) for inputting color picture data; 

45 category discrimination means (2) for discriminating to color information of which one of a plurality of cate- 

gories of color information classified based on categorical perception of human beings the color picture data inputted 
from said color picture data inputting means (1) belong; 

picture data conversion means (3) for converting the color picture data so as to have the color information 
discriminated by said category discrimination means (2); and 

so region extraction means (4) for specifying and extracting, from the color picture data after conversion into the 

color information based on the categorical perception by said picture data conversion means (3), a partial region of 
a picture constructed from the color picture data after the conversion; 

said region extraction means (4) including color designation means for instructing a color to be specified in 
the picture, comparison means for comparing the color designated by said color designation means and colors of 

55 picture elements of the color picture data with each other, and means for determining, when a result of the compar- 
ison by said comparison means proves that the designated color and the colors of the picture elements of the color 
picture data are the same color, the picture elements to be picture elements which constitute the region to be spec- 
ified. 
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1 6. A color picture processing method, comprising the steps of: 

discriminating to color information of which one of a plurality of categories of color information classified 
based on categorical perception of human beings inputted color picture data belong; 

converting the color picture data so as to have the thus discriminated color information; and 
5 performing color changing processing of changing, based on the color picture data after conversion into the 

color information based on the categorical perception, some or all of colors of a picture constructed from the color 
picture data after the conversion. 

17. A color picture processing method as set forth in claim 16, characterized in that, in the color changing processing, 
to a color parameter which has information of at least one of a code of a color classified based on the categorical 

perception and a deviation between the color picture data and a representative color of a category to which the 
color picture data belongs. 



18. A color picture processing method as set forth in claim 17, characterized in that, in the color changing processing, 
is after a color to be changed in the picture is designated, the thus designated color and colors of picture elements of 

the color picture data are compared with each other, and when a result of the comparison proves that the designated 
color and the colors of the picture elements of the color picture data are the same color, the color parameter is 
changed, but when the result of the comparison proves that the designated color and the colors of the picture 
elements of the color picture data are different, the color parameter is not changed. 

20 

1 9. A color picture processing apparatus, comprising: 

color picture data inputting means (1) for inputting color picture data; 

category discrimination means (2) for discriminating to color information of which one of a plurality of cate- 
gories of color information classified based on categorical perception of human beings the color picture data inputted 
25 from said color picture data inputting means (1 ) belong; 

picture data conversion means (3) for converting the color picture data so as to have the color information 
discriminated by said category discrimination means (2); and 

color changing means (5) for changing, based on the color picture data after the conversion into the color 
information based on the categorical perception by said picture data conversion means (3), some or all of colors of 
30 a picture constructed from the color picture data after the conversion; 

said color changing means (5) including means for changing a color parameter which has information of at 
least one of a code of a color classified based on the categorical perception and a deviation between the color 
picture data and a representative color of a category to which the color picture data belong. 



35 20. A color picture processing method, comprising the steps of: 

discriminating to color information of which one of a plurality of categories of color information classified 
based on categorical perception of human beings inputted color picture data belong; 

converting the color picture data so as to have the thus discriminated color information; and 

performing data compression processing of the color picture data after the conversion into the color informa- 

40 tion based on the categorical perception. 



21 . A color picture processing apparatus, comprising: 

color picture data inputting means (1) for inputting color picture data; 

category discrimination means (2) for discriminating to color information of which one of a plurality of cate- 
45 gories of color information classified based on categorical perception of human beings the color picture data inputted 
from said color picture data inputting means (1) belong; 

picture data conversion means (3) for converting the color picture data so as to have the color information 
discriminated by said category discrimination means (2); and 

data compression means (6) for performing data compression processing of the color picture data after the 
so conversion into the color information based on the categorical perception by said picture data conversion means (3) . 



22. A color picture processing method, comprising the steps of: 

discriminating to color information of which one of a plurality of categories of color information classified 

based on categorical perception of human beings inputted color picture data belong; 

converting the color picture data so as to have the thus discriminated color information; and 

converting the color picture data after the conversion into the color information based on the categorical 

perception into picture displayable data, which can be inputted to picture displaying means (8) using means (9) for 

indicating a corresponding relationship between the color information based on the categorical perception and such 

picture displayable data. 
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23. A color picture processing method as set forth in claim 22, characterized in that the picture displayable data are 
three primary color information. 

24. A color picture processing apparatus, comprising: 

5 color picture data inputting means (1) for inputting color picture data; 

category discrimination means (2) for discriminating to color information of which one of a plurality of cate- 
gories of color information classified based on categorical perception of human beings the color picture data inputted 
from said color picture data inputting means (1) belong; 

picture data conversion means (3) for converting the color picture data so as to have the color information 
10 discriminated by said category discrimination means (2); and 

picture displayable data conversion means (7) for converting the color picture data after the conversion into 
the color information based on the categorical perception by said picture data conversion means (3) into picture 
displayable data, which can be inputted to picture displaying means (8), using means (9) for indicating a correspond- 
ing relationship between the color information based on the categorical perception and such picture displayable data. 

15 

25. A color picture processing apparatus, comprising: 

color picture data inputting means (1) for inputting color picture data: 

category discrimination means (2) for discriminating to color information of which one of a plurality of cate- 
gories of color information classified based on categorical perception of human beings the color picture data inputted 
20 from said color picture data inputting means (1) belong; 

picture data conversion means (3) for converting the color picture data so as to have the color information 
discriminated by said category discrimination means (2); 

region extraction means (4) for specifying and extracting, from the color picture data after conversion into the 
color information based on the categorical perception by said picture data conversion means (3), a partial region of 
25 a picture constructed from the color picture data after the conversion; 

color changing means (5) for changing, based on the color picture data after the conversion into the color 
information based on the categorical perception by said picture data conversion means (3). some or all of colors of 
a picture constructed from the color picture data after the conversion; 

data compression means (6) for performing data compression processing of the color picture data after the 
30 conversion into the color information based on the categorical perception by said picture data conversion means 
(3); and 

picture displayable data conversion means (7) for converting the color picture data after the conversion into 
the color information based on the categorical perception by said picture data conversion means (3) into picture 
displayable data, which can be inputted to picture displaying means (8), using means (9) for indicating a correspond- 
35 ing relationship between the color information based on the categorical perception and such picture displayable data. 

26. A color picture processing method characterized in that a particular color in a picture constructed from color picture 
data is designated to extract an arbitrary body region and a color of the arbitrary body region in the picture is derived 
and changed to an aimed color designated separately, comprising the steps of: 

40 detecting to color information of which one of a plurality of categories of color information classified based 

on categorical perception of human beings the designated color or the derived body color or else the aimed color 
belongs; 

detecting to color information of which one of the plurality of categories of color information classified based 
on the categorical perception of human beings the color picture data of the body region before or after the color 
45 change belong; 

discriminating whether categories of the instructed color, the body color or the aimed color and the color 
picture data are same as or different from each other; and 

performing processing of requesting, based on a result of the discrimination, an operator for a change of the 
color picture data or for display of the result. 

so 

27. A color picture processing apparatus, comprising: 

a memory (1 1) for storing inputted color picture data; 

body region extraction means (12) for extracting an arbitrary body region of a picture constructed from the 
inputted color picture data designating a color; 
55 body color detection means (1 3) for detecting a body color of the body; 

aimed color designation means (14) for designating an aimed color for a color change of the body; 

color changing means (15) for changing the color of the body into the aimed color for a color change; 

first category discrimination means (16) for discriminating to color information of which one of a plurality of 
categories of color information classified based on categorical perception of human beings the designated color or 
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the derived body color or else the aimed color belongs; 

second category discrimination means (1 7) for discriminating to color information of which one of the plurality 
of categories of color information classified based on the categorical perception of human beings the color picture 
data of the body region before or after the color change belongs; 
5 category difference discrimination means (1 8) for discriminating whether the category of the designated color, 

the body color or the aimed color and the category of the color picture data discriminated by said first category 
discrimination means (16) and said second category discrimination means (17), respectively, are same as or different 
from each other; and 

picture data changing means (19) for changing the color picture data before or after the color change based 
70 on a result of the discrimination by said category difference discrimination means (18). 

28. A color picture processing apparatus as set forth in claim 27, characterized in that, when the discrimination by said 
category difference discrimination means (1 8) of whether the categories of the body color and the color picture data 
before the color change are same as or different from each other proves that the color picture data are partially 

is different in category from the body color, said picture data changing means (19) converts those color picture data 
which are different in category from the body color into color picture data of the same category as that of the body 
color. 

29. A color picture processing apparatus as set forth in claim 28, characterized in that, when the color picture data which 
20 are different in category from the body color are converted into the color picture data of the same category as that 

of the body color, said picture data changing means (19) changes those color picture data so as to be positioned 
on a boundary of the category of the body color. 

30. A color picture processing apparatus as set forth in claim 27, characterized in that, when the discrimination by said 
category difference discrimination means (1 8) of whether the categories of the body color and the color picture data 
before the color change are same as or different from each other proves that the color picture data are partially 
different in category from the body color, said picture data changing means (19) changes all of the color picture 
data into color picture data of the same category as that of the body color. 

A color picture processing apparatus as set forth in claim 30, characterized in that, when alt of the color picture data 
are changed into color picture data of the same category as that of the body color, said picture data changing means 
(19) first detects a straight line interconnecting the body color and each of the color picture data in a color space 
and then detects a crossing point between the straight line and a boundary of the category of the body color and 
also detects a distance between the crossing point and the color picture data, whereafter said picture data changing 
means (19) changes the positions of the color picture data in the color space in accordance with the positions of 
the body color and the individual color picture data so that that one of the color picture data whose distance is 
greatest among the distances may be included in the same category as that of the body color. 

32. A color picture processing apparatus as set forth in claim 27, characterized in that, when the discrimination by said 
40 category difference discrimination means (18) of whether the categories of the aimed color and the color picture 

data after the color change are same as or different from each other proves that the color picture data are partially 
different in category from the aimed color, said picture data changing means (19) changes the color picture data 
which are different in category from the aimed color into color picture data of the same category as that of the aimed 
color. 

45 

33. A color picture processing apparatus as set forth in claim 32, characterized in that, when the color picture data which 
are different in category from the aimed color are converted into the color picture data of the same category as that 
of the aimed color, said picture data changing means (19) changes the color picture data so as to be positioned on 
a boundary of the category of the aimed color. 

so 

34. A color picture processing apparatus as set forth in claim 27, characterized in that, when the discrimination by said 
category difference discrimination means (18) of whether the categories of the aimed color and the color picture 
data after the color change are same as or different from each other proves that the color picture data are partially 
different in category from the aimed color, said picture data changing means (19) changes all of those color picture 

55 data which are different in category from the aimed color into color picture data of the same category as that of the 
aimed color. 

35. A color picture processing apparatus as set forth in claim 34, characterized in that, when all of the color picturedata 
are changed into color picture data of the same category as that of the aimed color, said picture data changing 
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means (19) first detects a straight line interconnecting the aimed color and each of those color picture data in a 
color space and then detects a crossing point between the straight line and a boundary of the category of the aimed 
color and also detects a distance between the crossing point and the color picture data, whereafter said picture data 
changing means (19) changes the positions of the color picture data in the color space in accordance with the 
5 positions of the aimed color and the individual color picture data so that that one of the color picture data whose 

distance is greatest among the distances may be included in the same category as that of the aimed color. 

36. A color picture processing method characterized in that a color of an arbitrary body region in a color picture is 
changed by changing a position of data indicating the body region in a color space, comprising the steps of: 

10 discriminating whether data indicating the body region before and after a color change belong, when the data 

are converted into a plurality of colors classified based on categorical perception of human beings, to the same 
category or to different categories; and 

changing the positions of the data in the color space based on a result of the discrimination to change the 
color of the body. 

15 

37. A color picture processing apparatus characterized in that a color of an arbitrary body region in a color picture is 
changed by changing a position of data indicating the body region in a color space, comprising: 

a memory (21) for storing body region data; 

body color detection means (22) for detecting a body color of the body data; 
20 aimed color designation means (23) for designating an aimed color for a color change of the body data; 

category discrimination means (24) for discriminating to color information of which one of a plurality of cat- 
egories of color information classified based on categorical perception of human beings the body color data indi- 
cating the body region before and after a color change and the aimed color data belong; and 

data conversion means (25) for converting the data so as to have the color information discriminated by said 
25 category discrimination means (24). 

38. A color picture processing apparatus as set forth in claim 37, further comprising: 

category difference discrimination means (26) for discriminating whether or not the data obtained by the 
conversion by said data conversion means (25) and indicating the body region before and after the color change 
30 belong to the same category; and 

color changing means (27) for changing the position of the data in the color space based on a result of the 
discrimination by said category difference discrimination means (26) to change the color of the body. 

39. A color picture processing apparatus as set forth in claim 38, characterized in that said category difference discrim- 
35 ination means (26) includes derived color category detection means for detecting a category of a derived color 

derived from the body region, aimed color category detection means for detecting a category of an aimed color 
designated as a color to be aimed for a color change, and category comparison means for comparing the categories 
of the derived color and the aimed color detected by said derived color category detection means and said aimed 
color category detection means with each other. 

40 

40. A color picture processing apparatus as set forth in claim 38, characterized in that the color space is constructed 
as a space which can be represented in brightness, saturation and hue, and said color changing means (27) includes 
means for changing a value of at least one of the brightness, the saturation and the hue. 

45 41. A color picture processing apparatus as set forth in claim 40, characterized in that said color changing means (27) 
includes means for rotationally moving, when the categories of the body color and the aimed color are same as 
each other, a distribution of the data in the color space around a center provided by a straight line representing 
achromatic colors while maintaining a positional relationship of the data with respect to a plane which includes the 
straight line representing the achromatic colors and a point of the derived color, and means for rotationally moving, 

so when the categories of the body color and the aimed color are different from each other, the distribution of the data 
in the color space around the straight line while reversing the distribution of the data with respect to the plane. 

42. A color picture processing apparatus as set forth in claim 40, characterized in that said color changing means (27) 
includes means for performing data decompression processing or data compression processing of the data in the 

55 color space in the direction of the brightness to change the value in brightness. 

43. A color picture processing apparatus as set forth in claim 40, characterized in that said color changing means (27) 
includes means for performing data decompression processing or data compression processing of the data in the 
color space in the direction of the saturation to change the value in saturation. 
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44. A color picture processing apparatus as set forth in claim 40, characterized in that said color changing means (27) 
includes means for performing data rotating processing of the data in the color space around a straight line repre- 
senting achromatic colors to change the value in hue. 
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(57) The invention provides a color picture process- 
ing method and a color picture processing apparatus by 
which the amount of picture data can be reduced with- 
out degrading the picture quality in accordance with the 
sensations of human beings and further reduction in 
amount of data can be realized by data compression 
without degrading the picture quality and besides 
extraction of a body, a color change and reduction in 
number of colors can be performed simply. The color 
picture processing apparatus comprises a color picture 
data inputting section (1), a category discrimination sec- 
tion (2) for discriminating, from color picture data, color 
information based on categorical perception of human 
beings, a picture data conversion section (3) for con- 
verting the color picture data, a region extraction section 
(4) for specifying and extracting a partial region of a pic- 
ture, a color changing section (5) for changing some or 
all of colors of the picture, a data compression section 
(6) for compressing the color picture data after the con- 
version, and a picture display able data conversion sec- 
tion (7) for converting the color picture data after the 
conversion into picture displayable data to be inputted to 
a picture displaying section (3) using a table (9) which 
indicates a corresponding relationship between the 
color information and the picture displayable data. 
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